Apr 18 09:02:36 user devstack@n-api.service[61591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 09:02:36 user devstack@n-api.service[61591]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 09:02:36 2023] *** Apr 18 09:02:36 user devstack@n-api.service[61591]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 09:02:36 user devstack@n-api.service[61591]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 09:02:36 user devstack@n-api.service[61591]: nodename: user Apr 18 09:02:36 user devstack@n-api.service[61591]: machine: x86_64 Apr 18 09:02:36 user devstack@n-api.service[61591]: clock source: unix Apr 18 09:02:36 user devstack@n-api.service[61591]: pcre jit disabled Apr 18 09:02:36 user devstack@n-api.service[61591]: detected number of CPU cores: 12 Apr 18 09:02:36 user devstack@n-api.service[61591]: current working directory: / Apr 18 09:02:36 user devstack@n-api.service[61591]: detected binary path: /usr/bin/uwsgi-core Apr 18 09:02:36 user devstack@n-api.service[61591]: your processes number limit is 63638 Apr 18 09:02:36 user devstack@n-api.service[61591]: your memory page size is 4096 bytes Apr 18 09:02:36 user devstack@n-api.service[61591]: detected max file descriptor number: 2048 Apr 18 09:02:36 user devstack@n-api.service[61591]: lock engine: pthread robust mutexes Apr 18 09:02:36 user devstack@n-api.service[61591]: thunder lock: enabled Apr 18 09:02:36 user devstack@n-api.service[61591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 09:02:36 user devstack@n-api.service[61591]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 09:02:36 user devstack@n-api.service[61591]: Python main interpreter initialized at 0x55d12e6ec990 Apr 18 09:02:36 user devstack@n-api.service[61591]: python threads support enabled Apr 18 09:02:36 user devstack@n-api.service[61591]: your server socket listen backlog is limited to 100 connections Apr 18 09:02:36 user devstack@n-api.service[61591]: your mercy for graceful operations on workers is 90 seconds Apr 18 09:02:36 user devstack@n-api.service[61591]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 09:02:36 user devstack@n-api.service[61591]: *** Operational MODE: preforking *** Apr 18 09:02:36 user devstack@n-api.service[61591]: *** uWSGI is running in multiple interpreter mode *** Apr 18 09:02:36 user devstack@n-api.service[61591]: spawned uWSGI master process (pid: 61591) Apr 18 09:02:36 user devstack@n-api.service[61591]: spawned uWSGI worker 1 (pid: 61592, cores: 1) Apr 18 09:02:36 user devstack@n-api.service[61591]: spawned uWSGI worker 2 (pid: 61593, cores: 1) Apr 18 09:02:36 user devstack@n-api.service[61591]: spawned uWSGI worker 3 (pid: 61594, cores: 1) Apr 18 09:02:36 user devstack@n-api.service[61591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 09:02:37 user devstack@n-api.service[61593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 09:02:37 user devstack@n-api.service[61594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 09:02:37 user devstack@n-api.service[61592]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 09:02:40 user devstack@n-api.service[61592]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 09:02:40 user devstack@n-api.service[61592]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 09:02:40 user devstack@n-api.service[61592]: and ``live_migration_inbound_addr`` respectively. Apr 18 09:02:40 user devstack@n-api.service[61592]: ). Its value may be silently ignored in the future. Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 09:02:40 user devstack@n-api.service[61594]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 09:02:40 user devstack@n-api.service[61594]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 09:02:40 user devstack@n-api.service[61594]: and ``live_migration_inbound_addr`` respectively. Apr 18 09:02:40 user devstack@n-api.service[61594]: ). Its value may be silently ignored in the future. Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 09:02:40 user devstack@n-api.service[61593]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 09:02:40 user devstack@n-api.service[61593]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 09:02:40 user devstack@n-api.service[61593]: and ``live_migration_inbound_addr`` respectively. Apr 18 09:02:40 user devstack@n-api.service[61593]: ). Its value may be silently ignored in the future. Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61592) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61594) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61593) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 09:02:40 user devstack@n-api.service[61592]: INFO dbcounter [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Registered counter for database nova_api Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_db.sqlalchemy.engines [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61592) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writer thread running {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61594]: INFO dbcounter [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Registered counter for database nova_api Apr 18 09:02:40 user devstack@n-api.service[61593]: INFO dbcounter [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Registered counter for database nova_api Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61594) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_db.sqlalchemy.engines [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61593) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writer thread running {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writer thread running {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG nova.context [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82f4d1d5-971d-40da-bb81-ed51efeb387d(cell1) {{(pid=61592) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61592]: INFO dbcounter [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61592]: INFO dbcounter [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Registered counter for database nova_cell1 Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_db.sqlalchemy.engines [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61592) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG nova.context [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82f4d1d5-971d-40da-bb81-ed51efeb387d(cell1) {{(pid=61594) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writer thread running {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_db.sqlalchemy.engines [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61592) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG nova.context [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82f4d1d5-971d-40da-bb81-ed51efeb387d(cell1) {{(pid=61593) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61594]: INFO dbcounter [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:02:40 user devstack@n-api.service[61594]: INFO dbcounter [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Registered counter for database nova_cell1 Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:02:40 user devstack@n-api.service[61593]: INFO dbcounter [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61593]: INFO dbcounter [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Registered counter for database nova_cell1 Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61594) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writer thread running {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61594) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_db.sqlalchemy.engines [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61593) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_db.sqlalchemy.engines [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61593) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writer thread running {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writer thread running {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61592]: INFO dbcounter [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG oslo_db.sqlalchemy.engines [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61592) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writer thread running {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writer thread running {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writer thread running {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61593]: INFO dbcounter [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61594]: INFO dbcounter [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Registered counter for database nova_cell0 Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG oslo_db.sqlalchemy.engines [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61593) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writer thread running {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61594) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 09:02:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writer thread running {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 09:02:41 user devstack@n-api.service[61592]: WARNING keystonemiddleware.auth_token [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61592]: WARNING keystonemiddleware.auth_token [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61593]: WARNING keystonemiddleware.auth_token [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61593]: WARNING keystonemiddleware.auth_token [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61594]: WARNING keystonemiddleware.auth_token [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61594]: WARNING keystonemiddleware.auth_token [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61592]: WARNING keystonemiddleware.auth_token [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61592]: WARNING keystonemiddleware.auth_token [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d12e6ec990 pid: 61592 (default app) Apr 18 09:02:41 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:02:41 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001570 Apr 18 09:02:41 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 09:02:41 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:02:41 user devstack@n-api.service[61593]: WARNING keystonemiddleware.auth_token [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61593]: WARNING keystonemiddleware.auth_token [None req-778d70af-bd2f-41a4-9846-a3e20a47215f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61593]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d12e6ec990 pid: 61593 (default app) Apr 18 09:02:41 user devstack@n-api.service[61594]: WARNING keystonemiddleware.auth_token [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 09:02:41 user devstack@n-api.service[61594]: WARNING keystonemiddleware.auth_token [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 09:02:41 user devstack@n-api.service[61594]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d12e6ec990 pid: 61594 (default app) Apr 18 09:04:47 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-470aef7f-c4d1-4889-9834-d6b5db3462a5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001621 Apr 18 09:04:47 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:47 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:47 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:47 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:47 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:47 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-397c5ec5-a2bf-48d6-834f-6779fbee75d3 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:47 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-397c5ec5-a2bf-48d6-834f-6779fbee75d3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.416693 Apr 18 09:04:47 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 09:04:47 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:04:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002102 Apr 18 09:04:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:49 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:49 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:49 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:49 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:04:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-940bd562-e54d-41a5-8e1f-568440efd187 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-940bd562-e54d-41a5-8e1f-568440efd187 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.337177 Apr 18 09:04:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:04:49 2023] POST /compute/v2.1/flavors => generated 405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:04:49 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-900720f7-1ea2-4c6e-b4c4-0811fa91e2e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-900720f7-1ea2-4c6e-b4c4-0811fa91e2e1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087590 Apr 18 09:04:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 09:04:49 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:04:51 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:51 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 18 09:04:51 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:51 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-61d60d7c-6b12-4dba-9f05-2cb3200ab3c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-61d60d7c-6b12-4dba-9f05-2cb3200ab3c1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.105723 Apr 18 09:04:51 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:04:51 2023] POST /compute/v2.1/flavors => generated 402 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 09:04:51 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-90eea00a-c2eb-4bd4-8a7e-11e1664d9e04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:51 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-90eea00a-c2eb-4bd4-8a7e-11e1664d9e04 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027555 Apr 18 09:04:51 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 09:04:51 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:04:53 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:53 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002314 Apr 18 09:04:53 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:53 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:53 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-8b19b845-8e89-4093-81fb-b4668fa28269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:53 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-8b19b845-8e89-4093-81fb-b4668fa28269 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069520 Apr 18 09:04:53 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:04:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:04:53 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f17f8880-2269-48d8-a1a6-d5fd7911e2a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-f17f8880-2269-48d8-a1a6-d5fd7911e2a5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030802 Apr 18 09:04:54 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 09:04:53 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 09:04:55 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:55 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001346 Apr 18 09:04:55 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:56 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-48d9710e-cb37-4514-8611-a351574206f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d3", "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-48d9710e-cb37-4514-8611-a351574206f1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064961 Apr 18 09:04:56 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:04:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:04:56 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0d49d314-6491-4a82-8682-4beeb644d599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0d49d314-6491-4a82-8682-4beeb644d599 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028581 Apr 18 09:04:56 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 09:04:56 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:04:57 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:57 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001458 Apr 18 09:04:57 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:57 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-0fcefcde-60a6-4b16-8245-bb2262159e04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:57 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-0fcefcde-60a6-4b16-8245-bb2262159e04 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058246 Apr 18 09:04:57 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:04:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:04:58 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:04:58 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026269 Apr 18 09:04:58 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 09:04:57 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:04:59 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:04:59 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cf5b8e6f-23d0-4fd0-8516-96dc3a9b27fe None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001444 Apr 18 09:04:59 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:04:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:04:59 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b613300a-4f18-459e-b05b-eeae854efaf2 admin admin] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:00 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-b613300a-4f18-459e-b05b-eeae854efaf2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.102045 Apr 18 09:05:00 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 09:04:59 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:05:01 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:01 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001474 Apr 18 09:05:01 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:05:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:05:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:05:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:05:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:05:02 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a03152ad-d32b-4975-9e90-8d7884ec10e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "swap": 0, "vcpus": 1, "disk": 1}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-a03152ad-d32b-4975-9e90-8d7884ec10e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.316344 Apr 18 09:05:02 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:05:02 2023] POST /compute/v2.1/flavors => generated 400 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:05:02 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-3328e4de-2500-4149-83a9-da19b4b8e66d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:02 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-3328e4de-2500-4149-83a9-da19b4b8e66d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037068 Apr 18 09:05:02 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 09:05:02 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:05:04 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:04 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001390 Apr 18 09:05:04 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:05:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:04 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-8c6d8d6b-684f-49a5-9b67-725fae895dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "vcpus": 1, "ram": 2048}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-8c6d8d6b-684f-49a5-9b67-725fae895dc3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.115169 Apr 18 09:05:04 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:05:04 2023] POST /compute/v2.1/flavors => generated 403 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:05:04 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b9091c9f-1f1b-4273-bf2a-ce2fd39e8132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:04 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-b9091c9f-1f1b-4273-bf2a-ce2fd39e8132 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026526 Apr 18 09:05:04 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 09:05:04 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:05:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002377 Apr 18 09:05:06 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:05:06 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-790b2b09-b1dc-49ee-9100-111f74266761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-790b2b09-b1dc-49ee-9100-111f74266761 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073312 Apr 18 09:05:06 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:05:06 2023] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:05:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4f668a3d-c723-4aa2-99dc-9bdc54d9e227 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-4f668a3d-c723-4aa2-99dc-9bdc54d9e227 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024542 Apr 18 09:05:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 09:05:06 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:05:08 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:08 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001389 Apr 18 09:05:08 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:05:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:08 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-efba06fa-b3e8-4366-9372-177b4a992891 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:08 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-efba06fa-b3e8-4366-9372-177b4a992891 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060734 Apr 18 09:05:08 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:05:08 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:05:08 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ff648d61-9b96-4100-959d-177f42327a38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:08 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-ff648d61-9b96-4100-959d-177f42327a38 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027386 Apr 18 09:05:08 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 09:05:08 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:05:10 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:10 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001331 Apr 18 09:05:10 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 09:05:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:10 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2ab061b0-6381-4b48-89a8-b8e9002c7e7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:10 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-2ab061b0-6381-4b48-89a8-b8e9002c7e7f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.065166 Apr 18 09:05:10 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 09:05:10 2023] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:05:10 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-770dcbf1-eac9-41d0-835a-66f678db827e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:05:10 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-770dcbf1-eac9-41d0-835a-66f678db827e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023456 Apr 18 09:05:10 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 09:05:10 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:05:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-42742c31-bd8d-4c67-9241-c910a3214238 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002095 Apr 18 09:05:41 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 09:05:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:05:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:05:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087680 Apr 18 09:05:41 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 09:05:41 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:06:13 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-770dcbf1-eac9-41d0-835a-66f678db827e admin admin] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:06:13 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-770dcbf1-eac9-41d0-835a-66f678db827e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001619 Apr 18 09:06:13 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 09:06:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:06:13 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:06:13 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-21dbdcca-3a43-4a39-af17-8a79c2017a92 admin admin] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:06:13 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-21dbdcca-3a43-4a39-af17-8a79c2017a92 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.072823 Apr 18 09:06:13 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 09:06:13 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:06:17 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:06:17 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002487 Apr 18 09:06:17 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 09:06:17 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:06:17 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:06:17 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-c732cffc-1452-447a-84cd-3aba89e3920c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "m1.nano", "disk": 1, "id": "42", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:06:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-c732cffc-1452-447a-84cd-3aba89e3920c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.069260 Apr 18 09:06:18 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 09:06:17 2023] POST /compute/v2.1/flavors => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:06:18 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9a63a604-38be-40c6-a338-b9381fca59c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:06:18 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9a63a604-38be-40c6-a338-b9381fca59c7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029147 Apr 18 09:06:18 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 09:06:18 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:06:22 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:06:22 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ab2aee43-523d-4acc-821a-293ede535c6c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002212 Apr 18 09:06:22 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 09:06:22 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:06:22 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d4bfd7d0-39ee-4cfd-a365-d235fb6f805b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "name": "m1.micro", "ram": 192}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:06:22 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d4bfd7d0-39ee-4cfd-a365-d235fb6f805b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061950 Apr 18 09:06:22 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 09:06:22 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:06:22 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-500d012c-f5d6-42f7-9aeb-1c6c0fe4ffb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:06:22 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-500d012c-f5d6-42f7-9aeb-1c6c0fe4ffb8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024868 Apr 18 09:06:22 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 09:06:22 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 09:08:32 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:08:32 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:08:32 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:08:33 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d14a1ecb-0137-4b87-97ce-23a4ee656d53 tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf481090>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1618315087"}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d14a1ecb-0137-4b87-97ce-23a4ee656d53 tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.130584 Apr 18 09:08:34 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 09:08:32 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 2134 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 09:08:34 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:08:34 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-f8026373-af8e-4315-9d4a-419b910c985a tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Calling method '.version_select at 0x7f0dcf42dc60>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:35 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-f8026373-af8e-4315-9d4a-419b910c985a tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7" status: 200 len: 342 microversion: 2.1 time: 0.464094 Apr 18 09:08:35 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:08:34 2023] GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7 => generated 342 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:08:36 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:08:36 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-e48dad94-4771-4c9d-9e7d-497e6c2f9579 tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Calling method '.version_select at 0x7f0dcf466c20>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:36 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-e48dad94-4771-4c9d-9e7d-497e6c2f9579 tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7" status: 200 len: 342 microversion: 2.1 time: 0.317197 Apr 18 09:08:36 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:08:36 2023] GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7 => generated 342 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:08:36 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-748a4afc-ffb4-42ee-94eb-febb17162fea tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Calling method '.version_select at 0x7f0dcf310310>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:36 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-748a4afc-ffb4-42ee-94eb-febb17162fea tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7" status: 202 len: 0 microversion: 2.1 time: 0.124129 Apr 18 09:08:36 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:08:36 2023] DELETE /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:08:36 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-40107be9-e583-4182-aa84-342a74348dbb tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Calling method '.version_select at 0x7f0dcf303d90>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:36 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-40107be9-e583-4182-aa84-342a74348dbb tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] HTTP exception thrown: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. Apr 18 09:08:36 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-40107be9-e583-4182-aa84-342a74348dbb tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Request method failure captured: Apr 18 09:08:36 user devstack@n-api.service[61592]: request: GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7 HTTP/1.1 Apr 18 09:08:36 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:08:36 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:08:36 user devstack@n-api.service[61592]: Connection: close Apr 18 09:08:36 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:08:36 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:08:36 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:08:36 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:08:36 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4QeffOjn9IdWdlMuxj1-9pZ8x_qPOE-xJHmVMUbPkjuousLS5G4z0cYQbUkz1DO_qawCDfs3ZXL2qboWxF2W5JdoBTeBE6Q0YDdIk9wfHoJw0osixYBlH-koOup89N1f7qaHBef4Ku7hrVP9_4NPVoihQupM2VIYRNEvE1F7ntaws Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Project-Id: e6076d6619a44f218a0fc1ba2031b6fa Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-45508353 Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6076d6619a44f218a0fc1ba2031b6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e6076d6619a44f218a0fc1ba2031b6fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e6076d6619a44f218a0fc1ba2031b6fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Tenant: tempest-VolumesSnapshotsTestJSON-45508353 Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Tenant-Id: e6076d6619a44f218a0fc1ba2031b6fa Apr 18 09:08:36 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-45508353 Apr 18 09:08:36 user devstack@n-api.service[61592]: X-User: tempest-VolumesSnapshotsTestJSON-45508353-project-member Apr 18 09:08:36 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:08:36 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:08:36 user devstack@n-api.service[61592]: X-User-Id: 83bb6243e32747c29fe7507ab7c98473 Apr 18 09:08:36 user devstack@n-api.service[61592]: X-User-Name: tempest-VolumesSnapshotsTestJSON-45508353-project-member Apr 18 09:08:36 user devstack@n-api.service[61592]: method: Apr 18 09:08:36 user devstack@n-api.service[61592]: exception: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. Apr 18 09:08:36 user devstack@n-api.service[61592]: action_args: {'id': '9bc6a7e1-8998-4406-9567-3362a87a10e7'} Apr 18 09:08:36 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. (HTTP 404) (Request-ID: req-ca66f9d6-5eeb-4fbd-a687-e8a10ef43b22) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. Apr 18 09:08:36 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:36 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-40107be9-e583-4182-aa84-342a74348dbb tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] Returning 404 to user: Volume 9bc6a7e1-8998-4406-9567-3362a87a10e7 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:36 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-40107be9-e583-4182-aa84-342a74348dbb tempest-VolumesSnapshotsTestJSON-45508353 tempest-VolumesSnapshotsTestJSON-45508353-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7" status: 404 len: 109 microversion: 2.1 time: 0.039483 Apr 18 09:08:36 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:08:36 2023] GET /compute/v2.1/os-volumes/9bc6a7e1-8998-4406-9567-3362a87a10e7 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0edcbdc2-3c83-4064-9ae4-bb5ada6adcd5 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf4feb00>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-656672959", "metadata": {"Type": "work"}}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0edcbdc2-3c83-4064-9ae4-bb5ada6adcd5 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61593]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Length: 121 Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: Apr 18 09:08:39 user devstack@n-api.service[61593]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-656672959", "metadata": {"Type": "work"}}} Apr 18 09:08:39 user devstack@n-api.service[61593]: method: Apr 18 09:08:39 user devstack@n-api.service[61593]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61593]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-656672959', 'metadata': {'Type': 'work'}}}} Apr 18 09:08:39 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise error Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0edcbdc2-3c83-4064-9ae4-bb5ada6adcd5 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0edcbdc2-3c83-4064-9ae4-bb5ada6adcd5 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123484 Apr 18 09:08:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 09:08:39 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-43ba0b59-387e-4d26-8989-bf62b59bf4de tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf310940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472032724", "metadata": {"Type": "work"}}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-43ba0b59-387e-4d26-8989-bf62b59bf4de tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61594]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61594]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61594]: Content-Length: 120 Apr 18 09:08:39 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61594]: Apr 18 09:08:39 user devstack@n-api.service[61594]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1472032724", "metadata": {"Type": "work"}}} Apr 18 09:08:39 user devstack@n-api.service[61594]: method: Apr 18 09:08:39 user devstack@n-api.service[61594]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 09:08:39 user devstack@n-api.service[61594]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1472032724', 'metadata': {'Type': 'work'}}}} Apr 18 09:08:39 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise error Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi '0' Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-43ba0b59-387e-4d26-8989-bf62b59bf4de tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-43ba0b59-387e-4d26-8989-bf62b59bf4de tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012839 Apr 18 09:08:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 09:08:39 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a677615b-aecb-4dfd-94cd-c38a7267efee tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf321480>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2053970525", "metadata": {"Type": "work"}}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a677615b-aecb-4dfd-94cd-c38a7267efee tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61592]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61592]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61592]: Content-Length: 119 Apr 18 09:08:39 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61592]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61592]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61592]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61592]: Apr 18 09:08:39 user devstack@n-api.service[61592]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2053970525", "metadata": {"Type": "work"}}} Apr 18 09:08:39 user devstack@n-api.service[61592]: method: Apr 18 09:08:39 user devstack@n-api.service[61592]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61592]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2053970525', 'metadata': {'Type': 'work'}}}} Apr 18 09:08:39 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise error Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi '' Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 09:08:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a677615b-aecb-4dfd-94cd-c38a7267efee tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-a677615b-aecb-4dfd-94cd-c38a7267efee tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015914 Apr 18 09:08:39 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 09:08:39 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2258e712-20de-4471-8dfe-e8fba19fa785 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Calling method '.version_select at 0x7f0dcfe91090>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-2258e712-20de-4471-8dfe-e8fba19fa785 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] HTTP exception thrown: Volume tempest-invalid-1347186310 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2258e712-20de-4471-8dfe-e8fba19fa785 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1347186310 HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61593]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: method: Apr 18 09:08:39 user devstack@n-api.service[61593]: exception: Volume tempest-invalid-1347186310 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: action_args: {'id': 'tempest-invalid-1347186310'} Apr 18 09:08:39 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1347186310 could not be found. (HTTP 404) (Request-ID: req-eb95fbbb-61f0-4f05-814c-53503a5a7348) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1347186310 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1347186310 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1347186310 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2258e712-20de-4471-8dfe-e8fba19fa785 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 404 to user: Volume tempest-invalid-1347186310 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-2258e712-20de-4471-8dfe-e8fba19fa785 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1347186310" status: 404 len: 99 microversion: 2.1 time: 0.045651 Apr 18 09:08:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 09:08:39 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1347186310 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-f18489da-734e-41d6-9647-fdac0a9e5d7f tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003943 Apr 18 09:08:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 09:08:39 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-f1325d59-fae8-47a9-9801-09054df4291f tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004487 Apr 18 09:08:39 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 09:08:39 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b2e297d-edc7-4f82-a78c-516d7218a94d tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Calling method '.version_select at 0x7f0dcf344ee0>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-9b2e297d-edc7-4f82-a78c-516d7218a94d tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] HTTP exception thrown: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b2e297d-edc7-4f82-a78c-516d7218a94d tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/os-volumes/294f3c09-e37e-47a9-9267-c3d81691dae9 HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61593]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:08:39 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61593]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61593]: method: Apr 18 09:08:39 user devstack@n-api.service[61593]: exception: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: action_args: {'id': '294f3c09-e37e-47a9-9267-c3d81691dae9'} Apr 18 09:08:39 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. (HTTP 404) (Request-ID: req-4d75cfeb-78c2-4787-82dd-c360ab2a3bcd) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. Apr 18 09:08:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b2e297d-edc7-4f82-a78c-516d7218a94d tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 404 to user: Volume 294f3c09-e37e-47a9-9267-c3d81691dae9 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9b2e297d-edc7-4f82-a78c-516d7218a94d tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/294f3c09-e37e-47a9-9267-c3d81691dae9" status: 404 len: 109 microversion: 2.1 time: 0.042769 Apr 18 09:08:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:08:39 2023] DELETE /compute/v2.1/os-volumes/294f3c09-e37e-47a9-9267-c3d81691dae9 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d5b6eed2-6d98-4fad-b3b2-67467c626795 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Calling method '.version_select at 0x7f0dcf3109d0>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-d5b6eed2-6d98-4fad-b3b2-67467c626795 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] HTTP exception thrown: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d5b6eed2-6d98-4fad-b3b2-67467c626795 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Request method failure captured: Apr 18 09:08:39 user devstack@n-api.service[61594]: request: GET /compute/v2.1/os-volumes/332cf322-3733-4f69-9a92-181d4d75724c HTTP/1.1 Apr 18 09:08:39 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:08:39 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:08:39 user devstack@n-api.service[61594]: Connection: close Apr 18 09:08:39 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:08:39 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:08:39 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:08:39 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:08:39 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4XFBNUZXifQW2sQz2gClQFjBQneT7foAHz_44PDYR-6m3MNVX4xKdRbS-oXz4AgbpRS1N8IUBtd2AsOST60_v48Ry2gAacQrj14ZWuZbMOaJJ5-RPWWmZFFmitJJWk4lcUIEU6fIafT2pS6x-2SOYLInwovNYBfKNHJHSvMj6PiLs Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Project-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f188430cc60948f8999f1e7e30933a3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant-Id: f188430cc60948f8999f1e7e30933a3f Apr 18 09:08:39 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-VolumesNegativeTest-1745207881 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Id: 321281b36f87495099033b1f39790e37 Apr 18 09:08:39 user devstack@n-api.service[61594]: X-User-Name: tempest-VolumesNegativeTest-1745207881-project-member Apr 18 09:08:39 user devstack@n-api.service[61594]: method: Apr 18 09:08:39 user devstack@n-api.service[61594]: exception: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. Apr 18 09:08:39 user devstack@n-api.service[61594]: action_args: {'id': '332cf322-3733-4f69-9a92-181d4d75724c'} Apr 18 09:08:39 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. (HTTP 404) (Request-ID: req-dacdd170-d1f5-4a12-9b71-93559ed28afd) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. Apr 18 09:08:39 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:08:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d5b6eed2-6d98-4fad-b3b2-67467c626795 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] Returning 404 to user: Volume 332cf322-3733-4f69-9a92-181d4d75724c could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:08:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d5b6eed2-6d98-4fad-b3b2-67467c626795 tempest-VolumesNegativeTest-1745207881 tempest-VolumesNegativeTest-1745207881-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/332cf322-3733-4f69-9a92-181d4d75724c" status: 404 len: 109 microversion: 2.1 time: 0.041438 Apr 18 09:08:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:08:39 2023] GET /compute/v2.1/os-volumes/332cf322-3733-4f69-9a92-181d4d75724c => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:08:46 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640445819", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "b37fbb3e-0d38-451e-a046-f784799678e6"}]}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:46 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] validate_networks() for [('b37fbb3e-0d38-451e-a046-f784799678e6', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:08:46 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-5b089e85-271f-425d-9278-1dcd2e8d6eb3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf4feb90>, body: {"keypair": {"name": "tempest-keypair-1851106022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbo7pBgwcCr6LlBacmybE+WpMiAz5h5CtD6Ccnl7HxkUtg00W+ew6WM/ez0UBpxAzH/vOIatZLpLfjzWw0basNOTTzmse/3SDJModO8OP8rkTFaEW9zd7h3quX7DbD9aA=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:46 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-5b089e85-271f-425d-9278-1dcd2e8d6eb3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Getting quotas for project 8365dfe289f64b8296757c92d85d47e9. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:46 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-5b089e85-271f-425d-9278-1dcd2e8d6eb3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Getting quotas for user df17b369f8e842baaee174ac9f84181e and project 8365dfe289f64b8296757c92d85d47e9. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:46 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-5b089e85-271f-425d-9278-1dcd2e8d6eb3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196353 Apr 18 09:08:46 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 20/59] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:08:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Getting quotas for project eca30bdd994c46b19be2f7194e179669. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Getting quotas for user bbf3c3dde757444d9ca4f5e395cd3da7 and project eca30bdd994c46b19be2f7194e179669. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:08:48 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:08:48 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-5731ead8-5039-4a95-b184-958bf004e983 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.438995 Apr 18 09:08:48 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 21/60] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:08:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:08:48 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-780a8279-5151-4de3-96b0-136ba1b32c5a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:48 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-780a8279-5151-4de3-96b0-136ba1b32c5a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:08:48 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-780a8279-5151-4de3-96b0-136ba1b32c5a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:08:48 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-780a8279-5151-4de3-96b0-136ba1b32c5a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1211 microversion: 2.1 time: 0.173207 Apr 18 09:08:48 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:08:48 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:08:50 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-294115347", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:50 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] validate_networks() for [('dec1d623-368a-4168-81dd-2fc000e85d3a', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Getting quotas for project 0f30519aeb954065bdacf0d6f3774664. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Getting quotas for user f198d2ca88bc4444a37c480b8b34492a and project 0f30519aeb954065bdacf0d6f3774664. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:08:53 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:08:53 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0c52b4a0-705e-416f-bf55-414fca8e71fa tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.905459 Apr 18 09:08:53 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:08:50 2023] POST /compute/v2.1/servers => generated 381 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:08:53 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-50e860d8-9b3f-4036-880d-f8e6f3d2e6e6 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:53 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-50e860d8-9b3f-4036-880d-f8e6f3d2e6e6 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:08:53 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-50e860d8-9b3f-4036-880d-f8e6f3d2e6e6 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:08:53 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-50e860d8-9b3f-4036-880d-f8e6f3d2e6e6 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa" status: 200 len: 1215 microversion: 2.1 time: 0.245124 Apr 18 09:08:53 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 22/63] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:08:53 2023] GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:08:53 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-846518632", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:53 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] validate_networks() for [('dec1d623-368a-4168-81dd-2fc000e85d3a', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:08:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-937052609", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "016da8e2-ed42-4455-9c76-f449e8c3601c"}], "security_groups": [{"name": "tempest-securitygroup--182200505"}], "key_name": "tempest-keypair-1851106022", "user_data": "}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:54 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-7438f449-a904-4f35-8bd3-c7822425090e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf3e79a0>, body: {"keypair": {"name": "tempest-keypair-1719384074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGohvH7+XKTaff47klQLKRPUx+gzZlj6/ib1dgrMrTaVzsAm8gKHvYRb6oFJjC73ObXwndlkxdPmsOcfG7Muf7KqDWlxJgRxS/vqhnjfDd5I7wIX7sB8XI4isetLz65Qmg=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:54 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-7438f449-a904-4f35-8bd3-c7822425090e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Getting quotas for project 649be7e635114e7da65cecccaeaebacc. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:54 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-7438f449-a904-4f35-8bd3-c7822425090e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Getting quotas for user e624220b5403472babaacc756287288b and project 649be7e635114e7da65cecccaeaebacc. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-7438f449-a904-4f35-8bd3-c7822425090e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.412788 Apr 18 09:08:54 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:08:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:08:54 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] validate_networks() for [('016da8e2-ed42-4455-9c76-f449e8c3601c', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Getting quotas for project 0f30519aeb954065bdacf0d6f3774664. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Getting quotas for user f198d2ca88bc4444a37c480b8b34492a and project 0f30519aeb954065bdacf0d6f3774664. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:08:55 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:08:55 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-598ff78c-6a71-485d-8e1d-7c5fed101f46 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.130209 Apr 18 09:08:55 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:08:53 2023] POST /compute/v2.1/servers => generated 381 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:08:55 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d116c7ae-ffd7-4a37-b770-3c65e9808c43 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:55 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d116c7ae-ffd7-4a37-b770-3c65e9808c43 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:08:56 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-d116c7ae-ffd7-4a37-b770-3c65e9808c43 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:08:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-d116c7ae-ffd7-4a37-b770-3c65e9808c43 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 200 len: 1215 microversion: 2.1 time: 0.420793 Apr 18 09:08:56 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:08:55 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 1215 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Getting quotas for project 8365dfe289f64b8296757c92d85d47e9. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Getting quotas for user df17b369f8e842baaee174ac9f84181e and project 8365dfe289f64b8296757c92d85d47e9. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:08:56 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:08:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-f0a210e7-c5eb-4ab1-a819-29d8d6e53c61 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.775657 Apr 18 09:08:56 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:08:54 2023] POST /compute/v2.1/servers => generated 406 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:08:56 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ade07813-853b-4552-851c-4070b689363d tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:08:56 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ade07813-853b-4552-851c-4070b689363d tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:08:57 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-ade07813-853b-4552-851c-4070b689363d tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:08:57 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ade07813-853b-4552-851c-4070b689363d tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1232 microversion: 2.1 time: 0.160655 Apr 18 09:08:57 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 22/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:08:56 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1232 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:08:57 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1670009653", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e"}]}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:57 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:08:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:58 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Creating event network-changed:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61592) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-373ea5da-5c36-40f3-acd5-ac9d0bc2df34 req-70e8a5c9-7cbd-439a-9af5-f081a9b96d72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61592) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:08:58 user devstack@n-api.service[61592]: INFO nova.compute.rpcapi [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 09:08:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] Releasing lock "compute-rpcapi-router" {{(pid=61592) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 09:08:58 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-dc6b0e66-c5c5-4b7a-a662-1e913d60cde9 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251299 Apr 18 09:08:58 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:08:58 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] validate_networks() for [('8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for user 570a82a0281445b2a7bb2fc9d07342d3 and project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:09:00 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:00 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-4743bc7e-09f4-494d-9e81-ea7bd0226696 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.485643 Apr 18 09:09:00 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 24/70] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:08:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 2490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:00 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:00 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:00 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Creating event network-changed:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5730adb1-94f6-4274-8456-827cda354bd1 req-29c0210f-4012-428d-8355-1cfdbfbc2bf3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:00 user devstack@n-api.service[61594]: INFO nova.compute.rpcapi [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 09:09:00 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] Releasing lock "compute-rpcapi-router" {{(pid=61594) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 09:09:00 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-81a5c7bc-0a03-4497-9ab8-32e70bef214e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182649 Apr 18 09:09:00 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:00 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:00 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:00 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:00 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-07099891-0e63-460d-a9c4-be9343863e98 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 200 len: 1395 microversion: 2.87 time: 0.157174 Apr 18 09:09:00 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 25/72] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:09:00 2023] GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:09:02 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-580596262", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "aba84918-9ad1-41b8-9152-44484c4def7c"}], "security_groups": [{"name": "tempest-securitygroup--2137199852"}], "key_name": "tempest-keypair-1719384074", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:02 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] validate_networks() for [('aba84918-9ad1-41b8-9152-44484c4def7c', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:09:02 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] Creating event network-changed:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:09:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-eca9c8aa-2c29-48f1-aa2f-c9139636c112 req-b9469c8c-ed0d-4e74-b3a1-35765dd723dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101826 Apr 18 09:09:02 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:02 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:02 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] Creating event network-changed:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:09:02 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-4bcd48b3-612a-4191-a920-0edee3b6283c req-4038fda1-83b6-4800-be85-087c84049472 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028576 Apr 18 09:09:02 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 26/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Getting quotas for project 649be7e635114e7da65cecccaeaebacc. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Getting quotas for user e624220b5403472babaacc756287288b and project 649be7e635114e7da65cecccaeaebacc. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:09:03 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:09:03 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-d39c27cc-8549-48d8-94b3-2ea58cd8327e tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.350086 Apr 18 09:09:03 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:09:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:09:03 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6311ae58-1c76-4789-b133-b6e47226d2dc tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:03 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-6311ae58-1c76-4789-b133-b6e47226d2dc tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:03 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-6311ae58-1c76-4789-b133-b6e47226d2dc tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e624220b5403472babaacc756287288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649be7e635114e7da65cecccaeaebacc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:03 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-6311ae58-1c76-4789-b133-b6e47226d2dc tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 200 len: 1239 microversion: 2.1 time: 0.082833 Apr 18 09:09:03 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:03 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:05 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "name": "network-vif-plugged", "status": "completed", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] Creating event network-changed:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:09:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-7fe13158-caea-4ffb-a2cd-de37573dae68 req-4bf2b3b7-0715-448b-b9aa-3c8d990ab876 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050065 Apr 18 09:09:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Creating event network-vif-plugged:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61593) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-33340d81-8c49-49bf-9b52-cde2aaccb389 req-1e9ec973-0bac-4f64-99ad-54fa77951e9e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61593) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:06 user devstack@n-api.service[61593]: INFO nova.compute.rpcapi [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 09:09:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] Releasing lock "compute-rpcapi-router" {{(pid=61593) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 09:09:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-dedfe2d2-2710-42fd-87f5-cd89544bef73 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119092 Apr 18 09:09:06 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:07 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:07 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:09:07 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-2dde7e07-ac27-462e-a65f-054c3e66f04c req-91e74cfb-dd22-4188-8531-50551dbc203e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048226 Apr 18 09:09:07 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:08 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:08 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "name": "network-vif-plugged", "status": "completed", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}, {"server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "name": "network-vif-plugged", "status": "completed", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:08 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:08 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:08 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:08 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Creating event network-vif-plugged:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:09:08 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] Creating event network-vif-plugged:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:09:08 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-be311aa8-a3b6-4ba5-b6ec-4df6830d4f0a req-87daba64-d4b1-45ac-b90e-c73ff09a3219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037415 Apr 18 09:09:08 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:09 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:09 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=11 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:09 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:09 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:09 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:09 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:09:09 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-600e78e6-83de-470d-b4d2-d3d6e1db6c47 req-ff885d05-571a-4e0b-b256-7ba8f490b40d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057674 Apr 18 09:09:09 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:10 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:10 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "name": "network-vif-plugged", "status": "completed", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}, {"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}, {"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:10 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:10 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:10 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:10 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Creating event network-vif-plugged:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:09:10 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:09:10 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:09:10 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-6072167b-e202-4265-b0cc-486a2154b5ed req-21d91d3e-5abb-4cfa-87f2-685f4ed5a88b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057467 Apr 18 09:09:10 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:10 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=16 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:11 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "name": "network-vif-plugged", "status": "completed", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}, {"server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "name": "network-vif-plugged", "status": "completed", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Creating event network-vif-plugged:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:09:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] Creating event network-vif-plugged:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:09:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-9b109318-1eee-47ee-b82a-c77999d98e72 req-6af2ad96-5f9f-46bd-bb61-5c1aa0bccfc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090639 Apr 18 09:09:11 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:11 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:11 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] Creating event network-changed:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:09:11 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-65f214fc-438d-4aae-85ac-1e8091979b3e req-45d0ac66-70ca-4984-b857-b4c4d024d6e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092150 Apr 18 09:09:11 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:09:15 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=12 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:15 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "name": "network-vif-plugged", "status": "completed", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:15 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] Creating event network-vif-plugged:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:09:15 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-9f3dda5d-1026-4a47-85c7-52e0d588e59d req-c124a890-c85e-492c-9004-fe145221ee3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150050 Apr 18 09:09:15 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:16 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-42ab1bac-e6a2-4b61-adb5-187b97144856 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf2ea8c0>, body: {"keypair": {"name": "tempest-keypair-1542976355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNcCgVoxgZlmWuPc9KNuqcBniJBiR2dzMpNm8bJTTngvmWFYttt5VE+CyZtQxE84F+HDeZC9MT4FOYPYmC64t4hqG7TmHhO3kLBgjqwrxD3t7flxzMjzEEdBEVaKHYjGQ=="}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:16 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:16 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-42ab1bac-e6a2-4b61-adb5-187b97144856 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Getting quotas for project 6de09db7b7ec4d0cb31ba26355357254. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:16 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-42ab1bac-e6a2-4b61-adb5-187b97144856 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Getting quotas for user fd8629ceafed42a38046b0e441017eaa and project 6de09db7b7ec4d0cb31ba26355357254. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-42ab1bac-e6a2-4b61-adb5-187b97144856 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.507228 Apr 18 09:09:16 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:09:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=28 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "name": "network-vif-plugged", "status": "completed", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:18 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=15 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:18 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] Creating event network-vif-plugged:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:09:18 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-fee9bfc7-6c03-4dde-b1d7-8e1f33e32609 req-fcdd9d34-f616-4418-a40c-25af68b7d9bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105469 Apr 18 09:09:18 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:20 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-505708421", "imageRef": "bec27c55-e9ef-4212-827e-d37595e29ed8", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "2246ed88-e389-4aec-bd74-91483fea8a71"}], "security_groups": [{"name": "tempest-securitygroup--882410882"}], "key_name": "tempest-keypair-1542976355", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:20 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:20 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] validate_networks() for [('2246ed88-e389-4aec-bd74-91483fea8a71', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=15 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Getting quotas for project 6de09db7b7ec4d0cb31ba26355357254. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Getting quotas for user fd8629ceafed42a38046b0e441017eaa and project 6de09db7b7ec4d0cb31ba26355357254. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:09:21 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bec27c55-e9ef-4212-827e-d37595e29ed8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:09:21 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-b6940f81-762b-4d84-92a7-9fcacb6bac5e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.315835 Apr 18 09:09:21 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:09:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:09:21 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=16 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:21 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-fefccc26-2e9b-43e0-9dd0-7b71bc239cf7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:21 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-fefccc26-2e9b-43e0-9dd0-7b71bc239cf7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:22 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-fefccc26-2e9b-43e0-9dd0-7b71bc239cf7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8629ceafed42a38046b0e441017eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de09db7b7ec4d0cb31ba26355357254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:22 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-fefccc26-2e9b-43e0-9dd0-7b71bc239cf7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 200 len: 1239 microversion: 2.1 time: 0.568925 Apr 18 09:09:22 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:21 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 1239 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:29 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=5 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:29 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:29 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] Creating event network-changed:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:09:29 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-3db20a02-6e08-49a2-8f73-d236f726ea77 req-d394d9cd-dcb3-4c82-ac90-888178bbe683 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037005 Apr 18 09:09:29 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "name": "network-vif-plugged", "status": "completed", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] Creating event network-vif-plugged:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:09:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-2b8c1529-5775-4367-a1c4-c2375be62b80 req-ddc0aad5-21af-4035-965c-d2467065bf84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062398 Apr 18 09:09:34 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "name": "network-vif-plugged", "status": "completed", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:36 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:36 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] Creating event network-vif-plugged:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:09:36 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-f2678628-1ab2-4fda-a5d0-5adb03afd225 req-a5392a52-0f08-4a8b-b1fe-a996f9c638b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 Apr 18 09:09:36 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:09:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:09:36 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-19b87302-74ff-4a21-9e71-b61eda613b0e tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf2f6cb0>, body: {"keypair": {"name": "tempest-TestShelveInstance-816937350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt/rB6i8gstRNjvmduGqXj5ZyKl1MfQiCWIVA2qS5mQZ2nMCbYrGCI8colo3L6hmkwc22GQ0hEs5oCtSDHVBxYnvgCCG9WP5NDyml41RY1Uc5LkBkRTq2mr4tht1A1afg=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:36 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-19b87302-74ff-4a21-9e71-b61eda613b0e tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] Getting quotas for project 21e33ec94af34023b815f35d9c1b297f. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:36 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-19b87302-74ff-4a21-9e71-b61eda613b0e tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] Getting quotas for user c13c3f7b341e4faf91aca53d45ee70e6 and project 21e33ec94af34023b815f35d9c1b297f. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:36 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-19b87302-74ff-4a21-9e71-b61eda613b0e tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.227067 Apr 18 09:09:36 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:09:36 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:38 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:39 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-e26e2507-1efe-4897-8f1d-6083d9bc7ca6 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1494 microversion: 2.1 time: 0.347691 Apr 18 09:09:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 31/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:38 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1494 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-efa5ed79-eb6a-4d4c-959e-4e194bd452d5 tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] Calling method '.version_select at 0x7f0dcf2eb010>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-efa5ed79-eb6a-4d4c-959e-4e194bd452d5 tempest-TestShelveInstance-1260668014 tempest-TestShelveInstance-1260668014-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-816937350" status: 202 len: 0 microversion: 2.1 time: 0.028123 Apr 18 09:09:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 33/95] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 18 09:09:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-816937350 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:46 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:46 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-327fefce-fcfa-45c8-8886-5f80e959ff5b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 200 len: 1502 microversion: 2.1 time: 0.684596 Apr 18 09:09:46 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 32/96] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:46 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 1502 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:47 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-7462f631-7bff-421b-9494-a888eac41b59 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1537 microversion: 2.1 time: 0.491184 Apr 18 09:09:47 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:47 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1537 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:51 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:51 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:51 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-1a93d4d6-97c7-4aa8-a630-9312f7905a66 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 200 len: 1691 microversion: 2.87 time: 0.824155 Apr 18 09:09:51 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 34/98] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:09:50 2023] GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 1691 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:53 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e624220b5403472babaacc756287288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649be7e635114e7da65cecccaeaebacc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:53 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a16b4f68-5d10-4640-b3bd-3bce16edab26 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 200 len: 1554 microversion: 2.1 time: 0.343505 Apr 18 09:09:53 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:53 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 1554 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:09:55 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ccdb5cc6-e10d-481b-9020-0d50eb30c80d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Action: 'create', calling method: .version_select at 0x7f0dcf2d1a20>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1431295891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAM+eQqOKDVj1QEZsTh9RCgQHXTlPRnFH1HdV6zDDtdy6IKBiak5qSRSbj4S+0rCi8HS8cwmOR0P2XgCLFDNdd74y9WDtiV4YIHvrxiLZyXkx9MO7jeCGhcxTKNOUhLG0Q=="}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:55 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-ccdb5cc6-e10d-481b-9020-0d50eb30c80d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Getting quotas for project 443bf3c51a544117b68ba99b21b2529d. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:55 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-ccdb5cc6-e10d-481b-9020-0d50eb30c80d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Getting quotas for user 885f0d69bde44106aca29def44419a63 and project 443bf3c51a544117b68ba99b21b2529d. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:55 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ccdb5cc6-e10d-481b-9020-0d50eb30c80d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.246941 Apr 18 09:09:55 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 33/100] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:09:55 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:09:56 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-605332464", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1431295891", "security_groups": [{"name": "tempest-secgroup-smoke-338013043"}], "networks": [{"uuid": "14665473-0472-43b4-b63f-4943107a74bf"}]}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:09:57 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] validate_networks() for [('14665473-0472-43b4-b63f-4943107a74bf', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Getting quotas for project 443bf3c51a544117b68ba99b21b2529d. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Getting quotas for user 885f0d69bde44106aca29def44419a63 and project 443bf3c51a544117b68ba99b21b2529d. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:09:58 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:09:58 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d1ffd26c-a357-4f59-a58c-5761bb158c2b tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.656773 Apr 18 09:09:58 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 35/101] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:09:56 2023] POST /compute/v2.1/servers => generated 403 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:09:58 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c3595dbc-1f6d-4d49-a746-4b542448f5a7 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:09:58 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c3595dbc-1f6d-4d49-a746-4b542448f5a7 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:09:58 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-c3595dbc-1f6d-4d49-a746-4b542448f5a7 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '885f0d69bde44106aca29def44419a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443bf3c51a544117b68ba99b21b2529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:09:58 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c3595dbc-1f6d-4d49-a746-4b542448f5a7 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 200 len: 1256 microversion: 2.1 time: 0.101823 Apr 18 09:09:58 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:09:58 2023] GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 1256 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 09:10:03 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:03 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:03 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:03 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:03 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:03 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] Creating event network-changed:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:10:03 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-c9833f15-81b4-41be-ac9d-467483bb94bd req-87b1f3ec-7deb-4883-987f-4c7c5d42119e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037405 Apr 18 09:10:03 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 34/103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "name": "network-vif-plugged", "status": "completed", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] Creating event network-vif-plugged:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:10:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-df713266-1e83-4ba9-95cd-25638470e4ad req-34f4a1b6-cc6c-496c-8f24-2b46165a08d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033564 Apr 18 09:10:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 36/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:07 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=12 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:07 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f4b853a7-1c1c-441f-bbc8-e1ebb6c141b9 tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] Action: 'create', calling method: .version_select at 0x7f0dce9760e0>, body: {"keypair": {"name": "tempest-TestStampPattern-114269149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN96yC4ITgvz6XSFtuO9sxvPxTbGoR16t1a5mIotWQZkR0RmYS35JszY/aV1YKM3VFq//DY2cNAjbJDZTCAyE9Rd40MFTFHNUcBZ9y6l6NRP9hZRSbEw1KrMLBxv95pwEA=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:07 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:07 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-f4b853a7-1c1c-441f-bbc8-e1ebb6c141b9 tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] Getting quotas for project 6c2b12b2e28040b0aa20484e4c597eda. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:10:07 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-f4b853a7-1c1c-441f-bbc8-e1ebb6c141b9 tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] Getting quotas for user 2a46a6b086bb4977ae4bf16f8e6e4801 and project 6c2b12b2e28040b0aa20484e4c597eda. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:10:07 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-f4b853a7-1c1c-441f-bbc8-e1ebb6c141b9 tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.336697 Apr 18 09:10:07 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 35/105] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:10:07 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "name": "network-vif-plugged", "status": "completed", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:08 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:08 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] Creating event network-vif-plugged:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:10:08 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-f65acfa7-65df-4bbc-a4a5-148f730f2eb9 req-588bd589-662c-4387-abd5-8424e7936d04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046758 Apr 18 09:10:08 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:11 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-7fdc506a-1742-4345-b774-4d348fea937b tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] Calling method '.version_select at 0x7f0dce9377f0>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-7fdc506a-1742-4345-b774-4d348fea937b tempest-TestStampPattern-1478912314 tempest-TestStampPattern-1478912314-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-114269149" status: 202 len: 0 microversion: 2.1 time: 0.032269 Apr 18 09:10:11 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:10:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-114269149 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:12 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8629ceafed42a38046b0e441017eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de09db7b7ec4d0cb31ba26355357254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a6539126-bb9d-46b3-a898-d740f8d3b056 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 200 len: 1548 microversion: 2.1 time: 0.506174 Apr 18 09:10:12 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:12 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 1548 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:18 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-be0ffd37-e223-43e0-a9cf-3a720a73c622 tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] Action: 'create', calling method: .version_select at 0x7f0dce944ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-337464493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBic75e3K3N/VuW3BqpE3/WC6luMRsAzR0VUGJHLmJlJ1rcYly9gW+6e2sXGDNNC6LQmHshciNTAcrsaVia7MpZV5KFd7eFbn6HexNGxfVtxPYM0fZS3JZRyshVYNq+c+w=="}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:18 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-be0ffd37-e223-43e0-a9cf-3a720a73c622 tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] Getting quotas for project 272b695bacf541f4afc99eee80866e16. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:10:18 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-be0ffd37-e223-43e0-a9cf-3a720a73c622 tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] Getting quotas for user fe80780a678840af95cf78c85feb58aa and project 272b695bacf541f4afc99eee80866e16. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:10:18 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-be0ffd37-e223-43e0-a9cf-3a720a73c622 tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053012 Apr 18 09:10:18 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 36/109] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:10:18 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:22 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=10 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:22 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:22 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-440302ba-56e2-41cd-9727-f8cfdc069faa tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] Calling method '.version_select at 0x7f0dce9cd480>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:22 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-440302ba-56e2-41cd-9727-f8cfdc069faa tempest-TestVolumeBootPattern-171390432 tempest-TestVolumeBootPattern-171390432-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-337464493" status: 202 len: 0 microversion: 2.1 time: 0.031318 Apr 18 09:10:22 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Apr 18 09:10:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-337464493 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-912684621", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "b37fbb3e-0d38-451e-a046-f784799678e6"}]}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] validate_networks() for [('b37fbb3e-0d38-451e-a046-f784799678e6', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Getting quotas for project eca30bdd994c46b19be2f7194e179669. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Getting quotas for user bbf3c3dde757444d9ca4f5e395cd3da7 and project eca30bdd994c46b19be2f7194e179669. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:10:39 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:10:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-da965d02-09c6-47d1-93da-e5f0b0a530ac tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.644004 Apr 18 09:10:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 37/111] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:10:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-182e23f8-6c45-4d1a-82f8-aaa17ad57d4a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-182e23f8-6c45-4d1a-82f8-aaa17ad57d4a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:39 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-182e23f8-6c45-4d1a-82f8-aaa17ad57d4a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-182e23f8-6c45-4d1a-82f8-aaa17ad57d4a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 200 len: 1210 microversion: 2.1 time: 0.075981 Apr 18 09:10:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:39 2023] GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 1210 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:42 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:42 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] Creating event network-changed:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:10:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-b5f66c78-1c1a-4970-a129-93b86cd080f4 req-b48aa032-9244-4ea2-aa91-e8d1978f82f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046102 Apr 18 09:10:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:44 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "name": "network-vif-plugged", "status": "completed", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] Creating event network-vif-plugged:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:10:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-191677a5-1bcd-44af-8311-b5225e9777c4 req-e57eaae2-f685-4e27-b9bd-2793d8c04193 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044225 Apr 18 09:10:44 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 38/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:46 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "name": "network-vif-plugged", "status": "completed", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:46 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:46 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:46 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:46 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] Creating event network-vif-plugged:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:10:46 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-29247bd8-4425-46cf-b36a-b5ca55023383 req-98e7d2af-7bcb-4ec9-b14d-ef134210c448 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032092 Apr 18 09:10:46 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:47 user devstack@n-api.service[61592]: DEBUG nova.objects.instance [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lazy-loading 'flavor' on Instance uuid c266ddec-0869-4b84-8958-5058bb1d80e7 {{(pid=61592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 09:10:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-abf432d3-9cb7-4177-a96c-4fb996b7245e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7/action" status: 200 len: 32 microversion: 2.1 time: 0.177775 Apr 18 09:10:47 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 40/116] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 09:10:47 2023] POST /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:47 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:47 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c413e0ab-c64b-4cbf-8b08-332bd475ed08 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 200 len: 1508 microversion: 2.1 time: 0.219150 Apr 18 09:10:47 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 39/117] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:47 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:48 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-e7025d3f-e774-4113-b2a5-e7fe3db30163 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.269110 Apr 18 09:10:48 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:10:47 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85/os-interface => generated 282 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:48 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:48 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] Creating event network-vif-unplugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:10:48 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-4aebfe91-b817-4ac3-9b73-df803825e0fb req-70edad14-2cfc-404f-857c-73610701bd26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031915 Apr 18 09:10:48 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:48 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '885f0d69bde44106aca29def44419a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443bf3c51a544117b68ba99b21b2529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:48 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a96b7feb-3fca-4bce-874a-91b36e5d77d4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 200 len: 1567 microversion: 2.1 time: 0.294627 Apr 18 09:10:48 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:48 2023] GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] Creating event network-changed:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:10:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-b599312d-b0b5-4457-a54e-02ee08bbebf9 req-ec6c8b61-c817-4350-8fb9-aeeda6ade9d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042390 Apr 18 09:10:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:49 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-52d73a4a-e384-487f-a55f-9ce1fa046b87 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1537 microversion: 2.1 time: 0.261842 Apr 18 09:10:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:49 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1537 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:49 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-86786e35-a8d7-4e72-8c3a-fd200c0f989b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1537 microversion: 2.1 time: 0.179447 Apr 18 09:10:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:10:49 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:50 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:10:50 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:50 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:10:50 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-fe01e363-9cb6-4aa4-864d-bff77af588f7 req-ec70eea8-d224-4922-801e-87dd7c74c5db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040178 Apr 18 09:10:50 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-960860211"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}, {"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:10:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:10:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-aebf1b42-a47e-4d37-8325-3cf96ef94db4 req-93f3665c-878c-43d5-9e99-22a5f2a8b2e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036207 Apr 18 09:10:52 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:52 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-59a11e09-5d8e-4744-b1ed-8c59186886b8 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f/action" status: 202 len: 52 microversion: 2.87 time: 1.045474 Apr 18 09:10:52 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 43/126] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 09:10:51 2023] POST /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f/action => generated 52 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:54 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-6adec6e7-afe7-457e-b4af-f99cd362cb28 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.357121 Apr 18 09:10:54 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:10:53 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51/os-interface => generated 283 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:55 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:55 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] Creating event network-changed:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:10:55 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-25cbfac9-985d-43e2-83b8-7568ced82fba req-a9f57a60-dff0-4fbe-ba11-d7ed4df22eb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Apr 18 09:10:55 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:10:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-620377616"}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:55 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-acab8012-340c-4328-9bea-236ca6f425da tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51/action" status: 202 len: 0 microversion: 2.1 time: 0.924252 Apr 18 09:10:56 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 44/129] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 09:10:55 2023] POST /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 09:10:56 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-42f715b1-855d-4c6b-9188-7a42395845d2 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '.version_select at 0x7f0dce944550>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:56 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-42f715b1-855d-4c6b-9188-7a42395845d2 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5" status: 200 len: 1608 microversion: 2.1 time: 0.059717 Apr 18 09:10:56 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 09:10:56 2023] GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5 => generated 1608 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:58 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:10:58 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a013eaa5-60ef-4878-861e-42d7ba8bf539 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 200 len: 1691 microversion: 2.87 time: 0.264895 Apr 18 09:10:58 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 44/131] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:10:58 2023] GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=12 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-08a5cb71-95ef-4fe3-89e4-8bab68e0ff46 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.158100 Apr 18 09:11:12 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 45/132] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:11:12 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc/os-interface => generated 283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] Creating event network-changed:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:11:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-77b23d0f-e584-410f-b442-495e4b957139 req-4f376ee2-d792-4289-90e3-43acba7ed8a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033841 Apr 18 09:11:14 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=32 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:15 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:11:16 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "name": "network-vif-unplugged", "status": "completed", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] Creating event network-vif-unplugged:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:11:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-3e0d8b11-f0a8-4e1a-8195-b2616cbf5c3d req-309df3a0-730e-453d-8a95-e94cf4978f52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037462 Apr 18 09:11:16 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:16 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-73cbbcec-a44b-44e7-968e-1fcc7600d0f0 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 204 len: 0 microversion: 2.1 time: 0.599480 Apr 18 09:11:16 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:11:15 2023] DELETE /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:16 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8629ceafed42a38046b0e441017eaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de09db7b7ec4d0cb31ba26355357254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:16 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-0aa0270c-fdcd-4dc6-ab7e-9bc9d0021a45 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 200 len: 1673 microversion: 2.1 time: 0.179927 Apr 18 09:11:16 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:16 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:18 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "name": "network-vif-plugged", "status": "completed", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}, {"server_uuid": "d42e34ef-023d-4b4c-85ac-bc96597e5edc", "name": "network-vif-deleted", "tag": "d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Creating event network-vif-plugged:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:11:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] Creating event network-vif-deleted:d05b9785-86bb-4e4f-8a47-1c8ad9e44cd3 for instance d42e34ef-023d-4b4c-85ac-bc96597e5edc on user Apr 18 09:11:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-efae847a-5a42-4093-9256-0d75737f986a req-d2a9690f-e126-4fec-8d81-eb42f7d74ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029743 Apr 18 09:11:18 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:29 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:29 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:29 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:29 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=7,nova_api:UPDATE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:30 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-cd6b1df0-0e01-4480-bb4e-077b72ccc2db tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 200 len: 1494 microversion: 2.1 time: 0.229767 Apr 18 09:11:30 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:29 2023] GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 1494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=8 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:37 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-3fceb496-39d8-4adc-8abe-8eb05e8c388a tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 200 len: 1488 microversion: 2.1 time: 0.260698 Apr 18 09:11:37 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:37 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 1488 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=8 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:40 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-4a84de1f-136c-40bb-96e8-1e97a34dfcb1 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.215734 Apr 18 09:11:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:40 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:40 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-caf68ce2-02d5-4503-bd4f-3848ac97c15b tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.160391 Apr 18 09:11:40 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:40 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:46 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-e6b1c817-ec31-4e1b-9f4c-87b1c518bb23 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '.version_select at 0x7f0dce947760>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:46 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-e6b1c817-ec31-4e1b-9f4c-87b1c518bb23 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5" status: 200 len: 1722 microversion: 2.1 time: 0.061492 Apr 18 09:11:46 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 09:11:46 2023] GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5 => generated 1722 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:46 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-761fb012-ce08-409c-b6cd-f8f4ccc8edf5 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '.version_select at 0x7f0dce9cf1c0>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-761fb012-ce08-409c-b6cd-f8f4ccc8edf5 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5" status: 200 len: 1722 microversion: 2.1 time: 0.046944 Apr 18 09:11:46 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 09:11:46 2023] GET /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5 => generated 1722 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:46 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:46 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:47 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e624220b5403472babaacc756287288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649be7e635114e7da65cecccaeaebacc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:47 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-aa157df3-c058-458e-b68f-218ae34c9c7a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 200 len: 1673 microversion: 2.1 time: 0.231986 Apr 18 09:11:47 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:46 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 1673 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:48 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:48 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:48 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:48 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:49 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '885f0d69bde44106aca29def44419a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443bf3c51a544117b68ba99b21b2529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-42991bd0-b6f1-4141-9fe5-ef668e3744b6 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 200 len: 1567 microversion: 2.1 time: 0.223448 Apr 18 09:11:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:48 2023] GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:50 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:11:50 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d0bc9da7-ae39-4e76-adc3-6e6e146ea253 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 204 len: 0 microversion: 2.1 time: 0.122767 Apr 18 09:11:50 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 50/146] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:11:50 2023] DELETE /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:51 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '885f0d69bde44106aca29def44419a63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443bf3c51a544117b68ba99b21b2529d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:51 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0b6ad7b2-9f3a-4044-8bca-b2fff8fe35f9 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 200 len: 1573 microversion: 2.1 time: 0.196763 Apr 18 09:11:51 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:11:50 2023] GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 1573 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:11:51 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "name": "network-vif-unplugged", "status": "completed", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:51 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] Creating event network-vif-unplugged:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:11:51 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-13eff620-1230-468e-9d4a-d54be8733d3b req-2151921a-00a1-4ea5-ae72-503203f6187e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031105 Apr 18 09:11:51 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:52 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "name": "network-vif-deleted", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:52 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:52 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:52 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:52 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] Creating event network-vif-deleted:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:11:52 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-a3c7d459-5317-4993-aabd-2e4af04425ad req-91aa75f7-cd0e-4d04-9c73-2ed67d41baa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027713 Apr 18 09:11:52 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:53 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91efde89-c966-40a2-8dbb-208b134f8b4e", "name": "network-vif-plugged", "status": "completed", "tag": "5e266a4a-9f33-4ee1-8806-925ed0b8786e"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:53 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:53 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] Creating event network-vif-plugged:5e266a4a-9f33-4ee1-8806-925ed0b8786e for instance 91efde89-c966-40a2-8dbb-208b134f8b4e on user Apr 18 09:11:53 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-9ef8bd44-9ecc-40be-9533-acfaa705013a req-f5de1196-371d-4f8f-99dd-ffb8ae1f5bfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Apr 18 09:11:53 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1383834757", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e"}]}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] validate_networks() for [('8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for user 570a82a0281445b2a7bb2fc9d07342d3 and project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:11:59 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:11:59 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-06539895-f079-47fd-9481-b456a6abac05 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.529009 Apr 18 09:11:59 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 50/151] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:11:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 09:11:59 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:11:59 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:11:59 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:59 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:59 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:11:59 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-6c8ec357-40ef-4f3c-b233-a2d0e46fcbf3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892" status: 200 len: 1395 microversion: 2.87 time: 0.067305 Apr 18 09:11:59 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:11:59 2023] GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892 => generated 1395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:12:02 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa02f953-77fa-4e5b-8d94-2bcf0665d892", "tag": "f6e86c86-389e-4eda-bd4d-1444ea83d96a"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:02 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] Creating event network-changed:f6e86c86-389e-4eda-bd4d-1444ea83d96a for instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 on user Apr 18 09:12:02 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-264dde87-253f-4c9c-9133-68fe13d92ce2 req-ea10a381-f325-4172-8426-c88781501c75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Apr 18 09:12:02 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 51/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] HTTP exception thrown: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Request method failure captured: Apr 18 09:12:06 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc HTTP/1.1 Apr 18 09:12:06 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:12:06 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:12:06 user devstack@n-api.service[61594]: Connection: close Apr 18 09:12:06 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:12:06 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:12:06 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:12:06 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:12:06 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4iorQtAP4baOzACnqAYZZ18KHXKvOfRjK9bw2amqjxtlIaQzZzvjGtFX-NOcKjkzx6Ik_9_e8veSPPjXR1yMt71AMGXWiJ57L_9XxjI-60UOytu8JHfe-1KMWBcg5cGl27KJ4f0hh-kr1WJ4ehlRT5OEopWw-igPYojmjgBBGGoN8 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Project-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Tenant-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:06 user devstack@n-api.service[61594]: X-User: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:06 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:12:06 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:12:06 user devstack@n-api.service[61594]: X-User-Id: fd8629ceafed42a38046b0e441017eaa Apr 18 09:12:06 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:06 user devstack@n-api.service[61594]: method: > Apr 18 09:12:06 user devstack@n-api.service[61594]: exception: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:06 user devstack@n-api.service[61594]: action_args: {'id': 'd42e34ef-023d-4b4c-85ac-bc96597e5edc'} Apr 18 09:12:06 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Returning 404 to user: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:12:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-6175cc9c-a615-46c0-ba0b-6a3579ae914e tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 404 len: 111 microversion: 2.1 time: 0.032911 Apr 18 09:12:06 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:06 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:12:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-736534fb-3dd7-4d90-abda-89b62abf54a6 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '.version_select at 0x7f0dce9cf250>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-736534fb-3dd7-4d90-abda-89b62abf54a6 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542976355" status: 202 len: 0 microversion: 2.1 time: 0.029433 Apr 18 09:12:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:12:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542976355 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:12:07 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa02f953-77fa-4e5b-8d94-2bcf0665d892", "name": "network-vif-deleted", "tag": "f6e86c86-389e-4eda-bd4d-1444ea83d96a"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:07 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.compute.server_external_events [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] Unable to find a host for instance aa02f953-77fa-4e5b-8d94-2bcf0665d892. Dropping event network-vif-deleted {{(pid=61593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 09:12:07 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-fffae9d6-0f04-474b-8f00-69f8db563dfa req-6c77f36f-f344-46d9-ac6e-5749b61ec2f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031222 Apr 18 09:12:07 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:07 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] HTTP exception thrown: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Request method failure captured: Apr 18 09:12:07 user devstack@n-api.service[61594]: request: DELETE /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc HTTP/1.1 Apr 18 09:12:07 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:12:07 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:12:07 user devstack@n-api.service[61594]: Connection: close Apr 18 09:12:07 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:12:07 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:12:07 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:12:07 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:12:07 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4iorQtAP4baOzACnqAYZZ18KHXKvOfRjK9bw2amqjxtlIaQzZzvjGtFX-NOcKjkzx6Ik_9_e8veSPPjXR1yMt71AMGXWiJ57L_9XxjI-60UOytu8JHfe-1KMWBcg5cGl27KJ4f0hh-kr1WJ4ehlRT5OEopWw-igPYojmjgBBGGoN8 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Project-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Tenant-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61594]: X-User: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:07 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:12:07 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:12:07 user devstack@n-api.service[61594]: X-User-Id: fd8629ceafed42a38046b0e441017eaa Apr 18 09:12:07 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:07 user devstack@n-api.service[61594]: method: > Apr 18 09:12:07 user devstack@n-api.service[61594]: exception: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61594]: action_args: {'id': 'd42e34ef-023d-4b4c-85ac-bc96597e5edc'} Apr 18 09:12:07 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Returning 404 to user: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:12:07 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-a275993c-9ec7-4611-9133-943f3c23a994 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 404 len: 111 microversion: 2.1 time: 0.026307 Apr 18 09:12:07 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:12:07 2023] DELETE /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] [instance: d42e34ef-023d-4b4c-85ac-bc96597e5edc] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:07 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] HTTP exception thrown: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Request method failure captured: Apr 18 09:12:07 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc HTTP/1.1 Apr 18 09:12:07 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:12:07 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:12:07 user devstack@n-api.service[61592]: Connection: close Apr 18 09:12:07 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:12:07 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:12:07 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:12:07 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:12:07 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4iorQtAP4baOzACnqAYZZ18KHXKvOfRjK9bw2amqjxtlIaQzZzvjGtFX-NOcKjkzx6Ik_9_e8veSPPjXR1yMt71AMGXWiJ57L_9XxjI-60UOytu8JHfe-1KMWBcg5cGl27KJ4f0hh-kr1WJ4ehlRT5OEopWw-igPYojmjgBBGGoN8 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Project-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6de09db7b7ec4d0cb31ba26355357254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Tenant-Id: 6de09db7b7ec4d0cb31ba26355357254 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484484061 Apr 18 09:12:07 user devstack@n-api.service[61592]: X-User: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:07 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:12:07 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:12:07 user devstack@n-api.service[61592]: X-User-Id: fd8629ceafed42a38046b0e441017eaa Apr 18 09:12:07 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484484061-project-member Apr 18 09:12:07 user devstack@n-api.service[61592]: method: > Apr 18 09:12:07 user devstack@n-api.service[61592]: exception: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61592]: action_args: {'id': 'd42e34ef-023d-4b4c-85ac-bc96597e5edc'} Apr 18 09:12:07 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. Apr 18 09:12:07 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:07 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] Returning 404 to user: Instance d42e34ef-023d-4b4c-85ac-bc96597e5edc could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:12:07 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-012f2c37-82de-4eed-bb34-1133de4762b7 tempest-AttachSCSIVolumeTestJSON-484484061 tempest-AttachSCSIVolumeTestJSON-484484061-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc" status: 404 len: 111 microversion: 2.1 time: 0.032578 Apr 18 09:12:07 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:07 2023] GET /compute/v2.1/servers/d42e34ef-023d-4b4c-85ac-bc96597e5edc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:12:27 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=12 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:27 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=24 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:28 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2a852f26-8d72-4ad9-aa0d-933c79b05ca1 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Action: 'create', calling method: .version_select at 0x7f0dce9d8160>, body: {"keypair": {"name": "tempest-keypair-1862665852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJN5Ydit69pUA0q2xU7bCkLqQnU70p7kbxmSae49ddojgb1q74CMbsrEiWoBFRwLGPHlRrI3TXriMlgRVDue6y+/FmEfEItyyUfgyb+e4SnYhMq1u3W6og7gli00DD8LeA=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:28 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-2a852f26-8d72-4ad9-aa0d-933c79b05ca1 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for project 525646a9754f4dad81b0a412092eedba. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:12:28 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-2a852f26-8d72-4ad9-aa0d-933c79b05ca1 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for user 11696f31237843129128e4a6d13703cc and project 525646a9754f4dad81b0a412092eedba. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:12:28 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-2a852f26-8d72-4ad9-aa0d-933c79b05ca1 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263561 Apr 18 09:12:28 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:12:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1240764397", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "ad3712e3-340f-4ef3-8569-8e9513f35630"}], "security_groups": [{"name": "tempest-securitygroup--1152744738"}], "key_name": "tempest-keypair-1862665852", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:29 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] validate_networks() for [('ad3712e3-340f-4ef3-8569-8e9513f35630', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for project 525646a9754f4dad81b0a412092eedba. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for user 11696f31237843129128e4a6d13703cc and project 525646a9754f4dad81b0a412092eedba. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:12:30 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9183055b-ad35-4b99-ae9d-0aefe5158d9e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.616529 Apr 18 09:12:30 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:12:29 2023] POST /compute/v2.1/servers => generated 404 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-7c43e32d-7a94-43cc-aca0-4b72c941219f tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-7c43e32d-7a94-43cc-aca0-4b72c941219f tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-7c43e32d-7a94-43cc-aca0-4b72c941219f tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:30 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-7c43e32d-7a94-43cc-aca0-4b72c941219f tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8" status: 200 len: 1236 microversion: 2.1 time: 0.074982 Apr 18 09:12:30 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:30 2023] GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 => generated 1236 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:12:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a580d842-7b1f-4cdc-9a55-ddc0e24e8e30 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 204 len: 0 microversion: 2.1 time: 0.126285 Apr 18 09:12:30 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:12:30 2023] DELETE /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "name": "network-vif-unplugged", "status": "completed", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:30 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:30 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-cfa13bd6-5520-4aea-b67c-abe1de121d95 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 200 len: 1500 microversion: 2.1 time: 0.306036 Apr 18 09:12:30 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:30 2023] GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 1500 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:30 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:30 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] Creating event network-vif-unplugged:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:12:30 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-3aba7630-a677-45db-8284-36278696baca req-43318ccc-02be-4225-933e-e52de828b0e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033795 Apr 18 09:12:30 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:12:31 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "name": "network-vif-deleted", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] Creating event network-vif-deleted:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:12:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-7545e74d-3818-415e-ac12-ab1bd7874b5e req-7d9f8035-3415-4dae-b372-3baed00222d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031666 Apr 18 09:12:31 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f130904-8f2d-4bb8-be04-49ccc9cfeb4a", "name": "network-vif-plugged", "status": "completed", "tag": "deb7d669-2248-42f8-a650-00a3bcc0351d"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] Creating event network-vif-plugged:deb7d669-2248-42f8-a650-00a3bcc0351d for instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a on user Apr 18 09:12:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-9e0884c6-73b7-48d0-9822-396e8a9ee7c3 req-4d34c6ad-cc8d-4f20-8f6c-52bd0767bf1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030186 Apr 18 09:12:32 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:33 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] Creating event network-changed:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:12:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-83f9a6f8-851e-4ff4-bad8-10ad8473d653 req-81c363c3-e4d8-4426-a3e7-98195bae27cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028440 Apr 18 09:12:33 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 57/167] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:35 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "name": "network-vif-plugged", "status": "completed", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:35 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:35 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:35 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:35 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] Creating event network-vif-plugged:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:12:35 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-927848ef-bf1a-4758-9a37-d27753027554 req-dc47d873-b8f2-4d84-852c-1f9663acc86f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040808 Apr 18 09:12:35 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 56/168] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "name": "network-vif-plugged", "status": "completed", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] Creating event network-vif-plugged:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:12:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-0d2d94e9-82ea-4354-9b8e-4b4a56a12bd0 req-62a5e9b4-0823-4c74-9b12-88a1c85437e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028735 Apr 18 09:12:37 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:38 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:38 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-ba535c60-d903-4447-ab84-de3907795d6b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa" status: 200 len: 1502 microversion: 2.1 time: 0.223474 Apr 18 09:12:38 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 58/170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:37 2023] GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] [instance: 91efde89-c966-40a2-8dbb-208b134f8b4e] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] HTTP exception thrown: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Request method failure captured: Apr 18 09:12:41 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e HTTP/1.1 Apr 18 09:12:41 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:12:41 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:12:41 user devstack@n-api.service[61593]: Connection: close Apr 18 09:12:41 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:12:41 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:12:41 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:12:41 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:12:41 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl5XfV9z8oWPsHXY7V0OJZmNkQMT6yMYKEeXkStc7MePLhb9z5D2OwoG7yTAspJT34AFCJ_pRUNjiyKtTulg19g_jTdzdcmKpCO0k-v7zWRNloh37ltQ4BdCgo0LS8Y-l1kOFQuei5A8TEE0ii6dItYn4l__akLaCOypBrQTL1rVJLY Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Project-Id: 443bf3c51a544117b68ba99b21b2529d Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1188868867 Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/443bf3c51a544117b68ba99b21b2529d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/443bf3c51a544117b68ba99b21b2529d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/443bf3c51a544117b68ba99b21b2529d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Tenant: tempest-SnapshotDataIntegrityTests-1188868867 Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Tenant-Id: 443bf3c51a544117b68ba99b21b2529d Apr 18 09:12:41 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1188868867 Apr 18 09:12:41 user devstack@n-api.service[61593]: X-User: tempest-SnapshotDataIntegrityTests-1188868867-project-member Apr 18 09:12:41 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:12:41 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:12:41 user devstack@n-api.service[61593]: X-User-Id: 885f0d69bde44106aca29def44419a63 Apr 18 09:12:41 user devstack@n-api.service[61593]: X-User-Name: tempest-SnapshotDataIntegrityTests-1188868867-project-member Apr 18 09:12:41 user devstack@n-api.service[61593]: method: > Apr 18 09:12:41 user devstack@n-api.service[61593]: exception: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. Apr 18 09:12:41 user devstack@n-api.service[61593]: action_args: {'id': '91efde89-c966-40a2-8dbb-208b134f8b4e'} Apr 18 09:12:41 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. Apr 18 09:12:41 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:12:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Returning 404 to user: Instance 91efde89-c966-40a2-8dbb-208b134f8b4e could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:12:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-d98320f0-8a1f-46e8-8509-3213535cbf7d tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e" status: 404 len: 111 microversion: 2.1 time: 0.032353 Apr 18 09:12:41 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:41 2023] GET /compute/v2.1/servers/91efde89-c966-40a2-8dbb-208b134f8b4e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:12:41 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:41 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:41 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-1fc45663-fd1b-479f-972a-3d551d6b89a4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] Calling method '.version_select at 0x7f0dce8e6050>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-1fc45663-fd1b-479f-972a-3d551d6b89a4 tempest-SnapshotDataIntegrityTests-1188868867 tempest-SnapshotDataIntegrityTests-1188868867-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1431295891" status: 202 len: 0 microversion: 2.1 time: 0.026072 Apr 18 09:12:41 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 18 09:12:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1431295891 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-1cdefc94-c50c-4f6f-a091-bb5503901851 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.226742 Apr 18 09:12:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:41 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:47 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e624220b5403472babaacc756287288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649be7e635114e7da65cecccaeaebacc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:47 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-fea95b60-07a8-4d6d-9104-8b808d31e99a tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 200 len: 1673 microversion: 2.1 time: 0.235024 Apr 18 09:12:47 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:47 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=12 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-8e148a36-ef3b-493c-b794-2a9456d7339c tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '.version_select at 0x7f0dce8e7370>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-8e148a36-ef3b-493c-b794-2a9456d7339c tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5" status: 204 len: 0 microversion: 2.1 time: 0.213302 Apr 18 09:12:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:49 2023] DELETE /compute/v2.1/images/d8cfd587-507e-44fd-89a2-8f4884fc34f5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:12:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-92653b4b-5d52-4dd8-892f-f62cfe6810db tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 204 len: 0 microversion: 2.1 time: 0.112761 Apr 18 09:12:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 60/176] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:12:49 2023] DELETE /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:49 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e624220b5403472babaacc756287288b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649be7e635114e7da65cecccaeaebacc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-ba6fc6cd-876a-4baf-8ef7-2f075b789a42 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 200 len: 1679 microversion: 2.1 time: 0.183614 Apr 18 09:12:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:12:49 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG nova.objects.instance [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lazy-loading 'fault' on Instance uuid aa02f953-77fa-4e5b-8d94-2bcf0665d892 {{(pid=61594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "name": "network-vif-unplugged", "status": "completed", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] Creating event network-vif-unplugged:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:12:49 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-3e731756-7fcb-4ba7-8363-fe0155affcda req-359444ec-1db7-4cc6-81cb-2b70c177d0eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044072 Apr 18 09:12:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:50 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:50 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:50 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-f73c9102-c789-45e4-b340-336220edf292 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892" status: 200 len: 1650 microversion: 2.87 time: 0.163505 Apr 18 09:12:50 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:12:49 2023] GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892 => generated 1650 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Doing local delete in cell 82f4d1d5-971d-40da-bb81-ed51efeb387d(cell1) {{(pid=61593) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:50 user devstack@n-api.service[61593]: WARNING nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] instance's host None is down, deleting from database Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] deallocate_for_instance() {{(pid=61593) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Instance cache missing network info. {{(pid=61593) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Updating instance_info_cache with network_info: [] {{(pid=61593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 09:12:50 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61593) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 09:12:50 user devstack@n-api.service[61593]: WARNING nova.compute.api [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 09:12:50 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9a409dbc-34ba-411e-93fe-1c4a263a2204 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892" status: 204 len: 0 microversion: 2.87 time: 0.584407 Apr 18 09:12:50 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:12:50 2023] DELETE /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: aa02f953-77fa-4e5b-8d94-2bcf0665d892] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:50 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] HTTP exception thrown: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Request method failure captured: Apr 18 09:12:50 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892 HTTP/1.1 Apr 18 09:12:50 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:12:50 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:12:50 user devstack@n-api.service[61592]: Connection: close Apr 18 09:12:50 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:12:50 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:12:50 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:12:50 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:12:50 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4piJD8yF_P4GtIQoY5wZGTBQNnRtBYMuxQQ8L1vOYPpGOOuCFFlV_oiaSOAbFjrGYs4fQ5B8N1LZF0Zc57_iRwRTJ1Ny-fZjkVc29uUG4gntz9qFBt6gprMsjXD_zUNTkQuJPX_LogdpDsKIzKPncazkMG377jZNgLN38PjIW5N6c Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Project-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96fb7fa381004461936ab66be0403012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Tenant-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:12:50 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:12:50 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:12:50 user devstack@n-api.service[61592]: X-User-Id: 570a82a0281445b2a7bb2fc9d07342d3 Apr 18 09:12:50 user devstack@n-api.service[61592]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:12:50 user devstack@n-api.service[61592]: method: > Apr 18 09:12:50 user devstack@n-api.service[61592]: exception: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. Apr 18 09:12:50 user devstack@n-api.service[61592]: action_args: {'id': 'aa02f953-77fa-4e5b-8d94-2bcf0665d892'} Apr 18 09:12:50 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. Apr 18 09:12:50 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:12:50 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Returning 404 to user: Instance aa02f953-77fa-4e5b-8d94-2bcf0665d892 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:12:50 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-354ed10c-fbbd-4f8c-99b2-f2c986318931 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892" status: 404 len: 111 microversion: 2.87 time: 0.032325 Apr 18 09:12:50 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 62/181] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:12:50 2023] GET /compute/v2.1/servers/aa02f953-77fa-4e5b-8d94-2bcf0665d892 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 09:12:50 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1617525315", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e"}]}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:50 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] validate_networks() for [('8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for user 570a82a0281445b2a7bb2fc9d07342d3 and project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:12:51 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:12:51 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-25dadd87-fb53-4563-9df9-466efc1c013f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.564621 Apr 18 09:12:51 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 60/182] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:12:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 09:12:51 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:12:51 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:12:51 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:51 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:51 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:12:51 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-090cb926-a314-4908-8396-732fe06ef186 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 200 len: 1395 microversion: 2.87 time: 0.075762 Apr 18 09:12:51 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:12:51 2023] GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 1395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:12:51 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "name": "network-vif-deleted", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] Creating event network-vif-deleted:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:12:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-10988d6b-7f1f-43ca-ab34-d9527e5faff0 req-e38cf981-2522-492d-9a51-98d61a2fc240 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Apr 18 09:12:51 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 63/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:52 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1baed59-7d5c-4a94-b32a-4cdb76155b51", "name": "network-vif-plugged", "status": "completed", "tag": "c0ec1505-5790-47ed-98a7-111b18887140"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] Creating event network-vif-plugged:c0ec1505-5790-47ed-98a7-111b18887140 for instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 on user Apr 18 09:12:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-4e1bdaf9-d826-4313-afda-bf7427d04b3c req-ea38d5ec-def2-46df-977d-1ece336111f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030827 Apr 18 09:12:52 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:54 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] Creating event network-changed:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:12:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-74bfc80f-6087-4556-8a3e-e9a1c01b78ba req-ad5c802f-c185-41c4-a1db-c0c805f25335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029939 Apr 18 09:12:54 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:56 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "name": "network-vif-plugged", "status": "completed", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] Creating event network-vif-plugged:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:12:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-17216797-3f2f-43ac-bde6-328dcaa41eec req-a5f96837-34ef-4fa5-bee5-146b4743f555 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053550 Apr 18 09:12:56 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:12:58 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "name": "network-vif-plugged", "status": "completed", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:12:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:12:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:12:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:12:58 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] Creating event network-vif-plugged:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:12:58 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-59490529-08a0-4b3b-a73e-a47a94acbff8 req-5e65098d-28cd-4b0f-95e3-4cce335f0267 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Apr 18 09:12:58 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:20 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:20 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-427695fb-1c5e-48cd-b39c-d3748ea83193 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8" status: 200 len: 1545 microversion: 2.1 time: 0.233822 Apr 18 09:13:20 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:20 2023] GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 => generated 1545 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:20 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] HTTP exception thrown: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Request method failure captured: Apr 18 09:13:20 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a HTTP/1.1 Apr 18 09:13:20 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:13:20 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:13:20 user devstack@n-api.service[61592]: Connection: close Apr 18 09:13:20 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:13:20 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:13:20 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:13:20 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:13:20 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4d-9CPLeRSeNDxo4UbcSTW2ewMl0mzLzA_flE3EAQLC4YIwOPFQWrO9fzuV4h-20uap8H60l5cTZicZRBTNRlEWhCWEyrJmFwuxz-lATVwPhUGQlZGcEpzjkNJi6toniObPhocNYwrYJ875yVL1AFRuQpWSJZoJp1JBXXvCQu-wOw Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Project-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Project-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Tenant: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Tenant-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-User: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:13:20 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:13:20 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:13:20 user devstack@n-api.service[61592]: X-User-Id: bbf3c3dde757444d9ca4f5e395cd3da7 Apr 18 09:13:20 user devstack@n-api.service[61592]: X-User-Name: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:13:20 user devstack@n-api.service[61592]: method: > Apr 18 09:13:20 user devstack@n-api.service[61592]: exception: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:13:20 user devstack@n-api.service[61592]: action_args: {'id': '6f130904-8f2d-4bb8-be04-49ccc9cfeb4a'} Apr 18 09:13:20 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:13:20 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:13:20 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Returning 404 to user: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:13:20 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-0ae2a55d-8834-4b7f-aeaf-a449bacbf30d tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 404 len: 111 microversion: 2.1 time: 0.036213 Apr 18 09:13:20 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:20 2023] GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:20 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:21 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:21 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-98210dd2-5859-4beb-8e83-2dd1a5c9c880 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1494 microversion: 2.1 time: 0.223195 Apr 18 09:13:21 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:20 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1494 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] [instance: e1baed59-7d5c-4a94-b32a-4cdb76155b51] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] HTTP exception thrown: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Request method failure captured: Apr 18 09:13:39 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 HTTP/1.1 Apr 18 09:13:39 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:13:39 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:13:39 user devstack@n-api.service[61593]: Connection: close Apr 18 09:13:39 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:13:39 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:13:39 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:13:39 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:13:39 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4lTmpn25yfsvniYgk1kjfGyQ7NXAp6xeEucRWet2N4e8knuCvQv1V6wC8cDX5G6_sQThGKrXjxFnbuCnAq7aZuH3L5i9jdLoBZQXI4Laeh51qjTnvyWiqPujYIaeLy99d9C6A0l_F2OUOv52djKh3ioG-AEWPJ7qMLe9qvEupf3VE Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Project-Id: 649be7e635114e7da65cecccaeaebacc Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Project-Name: tempest-ServerStableDeviceRescueTest-158117995 Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/649be7e635114e7da65cecccaeaebacc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/649be7e635114e7da65cecccaeaebacc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/649be7e635114e7da65cecccaeaebacc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Tenant: tempest-ServerStableDeviceRescueTest-158117995 Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Tenant-Id: 649be7e635114e7da65cecccaeaebacc Apr 18 09:13:39 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-158117995 Apr 18 09:13:39 user devstack@n-api.service[61593]: X-User: tempest-ServerStableDeviceRescueTest-158117995-project-member Apr 18 09:13:39 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:13:39 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:13:39 user devstack@n-api.service[61593]: X-User-Id: e624220b5403472babaacc756287288b Apr 18 09:13:39 user devstack@n-api.service[61593]: X-User-Name: tempest-ServerStableDeviceRescueTest-158117995-project-member Apr 18 09:13:39 user devstack@n-api.service[61593]: method: > Apr 18 09:13:39 user devstack@n-api.service[61593]: exception: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. Apr 18 09:13:39 user devstack@n-api.service[61593]: action_args: {'id': 'e1baed59-7d5c-4a94-b32a-4cdb76155b51'} Apr 18 09:13:39 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. Apr 18 09:13:39 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:13:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Returning 404 to user: Instance e1baed59-7d5c-4a94-b32a-4cdb76155b51 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:13:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-bfc2ef5f-6894-4a93-b076-ba3029fbe3ae tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51" status: 404 len: 111 microversion: 2.1 time: 0.038758 Apr 18 09:13:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:39 2023] GET /compute/v2.1/servers/e1baed59-7d5c-4a94-b32a-4cdb76155b51 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:13:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-95f0d270-f0ce-445b-a960-a783b2141fd4 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] Calling method '.version_select at 0x7f0dce60a950>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-95f0d270-f0ce-445b-a960-a783b2141fd4 tempest-ServerStableDeviceRescueTest-158117995 tempest-ServerStableDeviceRescueTest-158117995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719384074" status: 202 len: 0 microversion: 2.1 time: 0.026206 Apr 18 09:13:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:13:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719384074 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:13:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9c13d9ea-2c0a-4aa6-8b41-a689c87f200e tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 204 len: 0 microversion: 2.1 time: 0.139763 Apr 18 09:13:41 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:13:41 2023] DELETE /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:41 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] Creating event network-vif-unplugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:13:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-e9e0742a-21ce-4b93-ae9b-6015dab2f69e req-a88a63ed-934d-4d9b-a25d-a035414af0e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030449 Apr 18 09:13:41 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:41 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-fe700c9f-3ae4-42c7-83e8-643cc0b0f158 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 200 len: 1494 microversion: 2.1 time: 0.685017 Apr 18 09:13:41 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:41 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 1494 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e1dec3cd-86d5-43a8-a7eb-836e4ed936a5 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 200 len: 1692 microversion: 2.87 time: 0.626033 Apr 18 09:13:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 67/197] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:13:41 2023] GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 1692 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-deleted", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] Creating event network-vif-deleted:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:13:42 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-72b4e654-7626-4988-a8c7-7d3174fa56bb req-85ed6116-c5e2-4ba6-9a20-b20e602eadc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029184 Apr 18 09:13:42 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 66/198] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:42 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:42 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-855d6642-2ace-4f4d-8b4f-a8d6995566d9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.444459 Apr 18 09:13:42 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:42 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-9cbe7fda-ded4-4277-a77c-5d6a26f9e3a9 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.252012 Apr 18 09:13:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 68/200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:42 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:43 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:43 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-fadc7e76-7545-43d9-8455-f960f81ce753 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.146867 Apr 18 09:13:43 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 67/201] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:42 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:43 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c266ddec-0869-4b84-8958-5058bb1d80e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8dbac7-bcc0-40c7-92a0-501ea79a77a0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:43 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] Creating event network-vif-plugged:ec8dbac7-bcc0-40c7-92a0-501ea79a77a0 for instance c266ddec-0869-4b84-8958-5058bb1d80e7 on user Apr 18 09:13:43 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-cc13f7c9-04fe-4eb0-b182-aa8c767eea75 req-f1466f15-6488-4781-ac36-f759e10c22cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039489 Apr 18 09:13:43 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 67/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:52 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-443ff162-8e23-4d0b-948c-c64c75359c09 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: .version_select at 0x7f0dce60a680>, body: {"keypair": {"name": "tempest-keypair-1493960909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmSrp3w6KokwKKSP1hxDTtpudQE7QZSfqBriZX+X03XJHTDnZsPZ2Xd15EDqiqwkBUC8S6+T9PQIPq9aSqDBDF/JHHG/7DNXBnBhRZJxBHm0HNHfYtFkfTbL3yE3xKe2A=="}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:52 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-443ff162-8e23-4d0b-948c-c64c75359c09 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:13:52 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-443ff162-8e23-4d0b-948c-c64c75359c09 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:13:52 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-443ff162-8e23-4d0b-948c-c64c75359c09 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138221 Apr 18 09:13:52 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 69/203] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:13:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:53 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1220494329", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c6b7356-c8ef-4d0d-b7c2-d96b8d362842"}], "security_groups": [{"name": "tempest-securitygroup--1829339385"}], "key_name": "tempest-keypair-1493960909", "user_data": "}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:53 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:53 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=16 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:53 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] validate_networks() for [('4c6b7356-c8ef-4d0d-b7c2-d96b8d362842', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:13:54 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:13:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a5f2325d-98eb-4f85-8be4-15a9205cd8b6 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.644480 Apr 18 09:13:54 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 68/204] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:13:53 2023] POST /compute/v2.1/servers => generated 400 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:13:54 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:54 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:54 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d9e6d9bd-55e8-4d27-9535-6a1245920904 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:13:54 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d9e6d9bd-55e8-4d27-9535-6a1245920904 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:13:54 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-d9e6d9bd-55e8-4d27-9535-6a1245920904 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:13:54 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d9e6d9bd-55e8-4d27-9535-6a1245920904 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 200 len: 1236 microversion: 2.1 time: 0.092555 Apr 18 09:13:54 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 68/205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:13:54 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:13:57 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=12 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:13:57 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:57 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:57 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] Creating event network-changed:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:13:57 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-dd940abf-5f45-4c97-8216-2885203e6485 req-d93428a4-c35b-4244-9d63-0aaa60d6c0b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034263 Apr 18 09:13:57 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 70/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:13:59 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:13:59 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:13:59 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:13:59 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:13:59 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:13:59 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-0ea83503-09a6-400c-85a5-813d9482c03e req-31f37eb1-006a-420d-a095-3443c6032a55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Apr 18 09:13:59 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:14:01 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:01 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:14:01 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-100d75da-a2a3-4762-81e1-cc44b17c48ed req-25347a75-cf62-4a2a-bb79-174d7c106feb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Apr 18 09:14:01 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:20 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-60b689bd-b6cd-4739-b54a-d9eec5bfad0e tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.162120 Apr 18 09:14:20 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:14:20 2023] GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:21 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] Creating event network-changed:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:14:21 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-897b8fe4-903f-4acb-9c0a-2f1c879b91c9 req-b45927cd-eab8-4f0a-9780-7f8a597c4185 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095780 Apr 18 09:14:21 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:22 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:22 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9090494e-8699-4f1e-9e47-8f6fcafaa261 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1494 microversion: 2.1 time: 0.239948 Apr 18 09:14:22 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:22 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1733726525", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "ad3712e3-340f-4ef3-8569-8e9513f35630"}]}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] validate_networks() for [('ad3712e3-340f-4ef3-8569-8e9513f35630', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for project 525646a9754f4dad81b0a412092eedba. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Getting quotas for user 11696f31237843129128e4a6d13703cc and project 525646a9754f4dad81b0a412092eedba. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:14:23 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:14:23 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d3795cf8-d5e2-451a-8cee-6b4efc5cb5fe tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.510190 Apr 18 09:14:23 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 72/212] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:14:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:14:23 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-4ccc298c-6f93-4ca0-aaa9-ff19fa80ca12 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:23 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-4ccc298c-6f93-4ca0-aaa9-ff19fa80ca12 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:23 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-4ccc298c-6f93-4ca0-aaa9-ff19fa80ca12 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:23 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-4ccc298c-6f93-4ca0-aaa9-ff19fa80ca12 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17" status: 200 len: 1212 microversion: 2.1 time: 0.062309 Apr 18 09:14:23 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:23 2023] GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 => generated 1212 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:14:26 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] Creating event network-changed:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:14:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-e0466ecd-627b-4980-840d-584aea16760d req-64670141-3c54-4985-9b75-c88412f81fc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031302 Apr 18 09:14:26 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:28 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "name": "network-vif-plugged", "status": "completed", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:28 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:28 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:28 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:28 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] Creating event network-vif-plugged:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:14:28 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-dcd6ae8d-f523-4fd4-bfcc-4ef86812bcf1 req-d4351bf6-9dbe-4399-9a0f-a8a77cb188e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 Apr 18 09:14:28 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "name": "network-vif-plugged", "status": "completed", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] Creating event network-vif-plugged:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:14:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-a28a48e7-a7b6-4b4b-92da-86ba0506d472 req-e235c02d-49bc-482f-968b-92005121d9f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Apr 18 09:14:30 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: c266ddec-0869-4b84-8958-5058bb1d80e7] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] HTTP exception thrown: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Request method failure captured: Apr 18 09:14:32 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 HTTP/1.1 Apr 18 09:14:32 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:14:32 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:14:32 user devstack@n-api.service[61594]: Connection: close Apr 18 09:14:32 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:14:32 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:14:32 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:14:32 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:14:32 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4iNBYguhuQx_nVDzkw6nqOrnmXjOky5weeghe-dXm8f23F0CsXgeYUzFDEVgevUzSNdtGeHrCIM_Al-ect3XaFqxUrR_NJOF6f3-KS5676MsiPEnrIw0vcEOZFbayAJvpSZMoS6hcQ24y9b6dMLdIsa-iIWsh4hMCTWRUfwXACi1k Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Project-Id: 0f30519aeb954065bdacf0d6f3774664 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Tenant-Id: 0f30519aeb954065bdacf0d6f3774664 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:14:32 user devstack@n-api.service[61594]: X-User: tempest-ServerRescueNegativeTestJSON-415455480-project-member Apr 18 09:14:32 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:14:32 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:14:32 user devstack@n-api.service[61594]: X-User-Id: f198d2ca88bc4444a37c480b8b34492a Apr 18 09:14:32 user devstack@n-api.service[61594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-415455480-project-member Apr 18 09:14:32 user devstack@n-api.service[61594]: method: > Apr 18 09:14:32 user devstack@n-api.service[61594]: exception: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. Apr 18 09:14:32 user devstack@n-api.service[61594]: action_args: {'id': 'c266ddec-0869-4b84-8958-5058bb1d80e7'} Apr 18 09:14:32 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. Apr 18 09:14:32 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Returning 404 to user: Instance c266ddec-0869-4b84-8958-5058bb1d80e7 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:14:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-597246b0-fcbe-43cf-9c17-dfdb9e78f811 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7" status: 404 len: 111 microversion: 2.1 time: 0.127028 Apr 18 09:14:32 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:31 2023] GET /compute/v2.1/servers/c266ddec-0869-4b84-8958-5058bb1d80e7 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:14:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e63d9860-05f6-4199-ad24-ffbe7b93173b tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa" status: 204 len: 0 microversion: 2.1 time: 0.130460 Apr 18 09:14:32 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:14:32 2023] DELETE /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-unplugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:32 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] Creating event network-vif-unplugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-675993f1-f807-4141-82de-b9b10e4150bc req-b60cef0c-e86d-4808-aa35-c49d3668c3ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098701 Apr 18 09:14:32 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 73/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:32 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f198d2ca88bc4444a37c480b8b34492a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f30519aeb954065bdacf0d6f3774664', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:32 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9220d631-9e10-419e-a613-76266503ba89 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa" status: 200 len: 1508 microversion: 2.1 time: 0.588010 Apr 18 09:14:32 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:32 2023] GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-deleted", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] Creating event network-vif-deleted:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-3a945f11-3bfa-4d00-a011-b608e8404bdd req-1b3ce209-8675-4e94-8683-e0245d26ac46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Apr 18 09:14:33 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:34 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}, {"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}, {"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}, {"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-unplugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}, {"server_uuid": "354beed7-726a-4dd4-89d9-33f1522349aa", "name": "network-vif-plugged", "status": "completed", "tag": "cb28ad76-aef3-4245-b05c-404fd351798f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Creating event network-vif-unplugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] Creating event network-vif-plugged:cb28ad76-aef3-4245-b05c-404fd351798f for instance 354beed7-726a-4dd4-89d9-33f1522349aa on user Apr 18 09:14:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-5440d950-1ffe-4f1a-bdc2-c4e5c5aff14c req-b949f342-8bfc-45bc-a1d4-28c4087bfb91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035796 Apr 18 09:14:34 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:14:34 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=10 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-515068896"}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:43 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-499d7112-dcf2-4250-879a-0ac5aaba7b69 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f/action" status: 202 len: 52 microversion: 2.87 time: 0.856949 Apr 18 09:14:43 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 74/223] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 09:14:42 2023] POST /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f/action => generated 52 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:44 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:44 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d3e33948-7a36-48db-bcdd-d4b48628d8c8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 200 len: 1547 microversion: 2.1 time: 0.252876 Apr 18 09:14:44 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:44 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 1547 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=10 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:44 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:44 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ad1d0222-b8cf-4c5c-bc66-87d3712a9c20 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.210994 Apr 18 09:14:44 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:14:44 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:48 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:14:48 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9f6b1ed3-b66a-4aa0-b274-e527c1a0539c tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 200 len: 1692 microversion: 2.87 time: 0.220398 Apr 18 09:14:48 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 75/226] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:14:48 2023] GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 1692 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:13 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:14 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:14 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-fd37f7cc-8334-4994-aa02-536871fea870 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17" status: 200 len: 1496 microversion: 2.1 time: 0.216033 Apr 18 09:15:14 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:13 2023] GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 => generated 1496 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] [instance: 354beed7-726a-4dd4-89d9-33f1522349aa] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:22 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] HTTP exception thrown: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Request method failure captured: Apr 18 09:15:22 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa HTTP/1.1 Apr 18 09:15:22 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:15:22 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:15:22 user devstack@n-api.service[61594]: Connection: close Apr 18 09:15:22 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:15:22 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:15:22 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:15:22 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:15:22 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4iNBYguhuQx_nVDzkw6nqOrnmXjOky5weeghe-dXm8f23F0CsXgeYUzFDEVgevUzSNdtGeHrCIM_Al-ect3XaFqxUrR_NJOF6f3-KS5676MsiPEnrIw0vcEOZFbayAJvpSZMoS6hcQ24y9b6dMLdIsa-iIWsh4hMCTWRUfwXACi1k Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Project-Id: 0f30519aeb954065bdacf0d6f3774664 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f30519aeb954065bdacf0d6f3774664"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Tenant-Id: 0f30519aeb954065bdacf0d6f3774664 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-415455480 Apr 18 09:15:22 user devstack@n-api.service[61594]: X-User: tempest-ServerRescueNegativeTestJSON-415455480-project-member Apr 18 09:15:22 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:15:22 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:15:22 user devstack@n-api.service[61594]: X-User-Id: f198d2ca88bc4444a37c480b8b34492a Apr 18 09:15:22 user devstack@n-api.service[61594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-415455480-project-member Apr 18 09:15:22 user devstack@n-api.service[61594]: method: > Apr 18 09:15:22 user devstack@n-api.service[61594]: exception: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. Apr 18 09:15:22 user devstack@n-api.service[61594]: action_args: {'id': '354beed7-726a-4dd4-89d9-33f1522349aa'} Apr 18 09:15:22 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. Apr 18 09:15:22 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:22 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] Returning 404 to user: Instance 354beed7-726a-4dd4-89d9-33f1522349aa could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:15:22 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-2864fa78-d77b-4333-a8c6-df5044a0fb81 tempest-ServerRescueNegativeTestJSON-415455480 tempest-ServerRescueNegativeTestJSON-415455480-project-member] 10.0.0.210 "GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa" status: 404 len: 111 microversion: 2.1 time: 0.032045 Apr 18 09:15:22 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:22 2023] GET /compute/v2.1/servers/354beed7-726a-4dd4-89d9-33f1522349aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:23 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:23 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-7ebf85fa-f0e3-4793-abc4-177fdfba635f tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1494 microversion: 2.1 time: 0.266428 Apr 18 09:15:23 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:23 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:27 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:27 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:27 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-aa88b2dc-bc87-4eaf-aee3-9e9abcc48c04 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Action: 'create', calling method: .version_select at 0x7f0dce9cf520>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2008414594", "metadata": {"Type": "work"}}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-aa88b2dc-bc87-4eaf-aee3-9e9abcc48c04 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.529016 Apr 18 09:15:27 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 78/230] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 09:15:27 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 530 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 09:15:27 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a56babe3-917a-4490-9481-8f0974ffc211 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Calling method '.version_select at 0x7f0dce75add0>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:27 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-a56babe3-917a-4490-9481-8f0974ffc211 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8" status: 200 len: 350 microversion: 2.1 time: 0.052423 Apr 18 09:15:27 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 77/231] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:15:27 2023] GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:28 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-12d0a79b-a25c-43d7-a7a9-73cdfe387f68 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Calling method '.version_select at 0x7f0dce63eb00>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:28 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-12d0a79b-a25c-43d7-a7a9-73cdfe387f68 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8" status: 200 len: 350 microversion: 2.1 time: 0.053711 Apr 18 09:15:28 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:15:28 2023] GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:28 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a9d5e861-930f-4fe5-8388-6894fd625ce3 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Calling method '.version_select at 0x7f0dce60b490>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:28 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-a9d5e861-930f-4fe5-8388-6894fd625ce3 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8" status: 202 len: 0 microversion: 2.1 time: 0.133562 Apr 18 09:15:28 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:15:28 2023] DELETE /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:15:28 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-5239e1b8-4181-4cdd-a3d3-00863cf3bf70 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Calling method '.version_select at 0x7f0dce75a9e0>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:28 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-5239e1b8-4181-4cdd-a3d3-00863cf3bf70 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] HTTP exception thrown: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. Apr 18 09:15:28 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-5239e1b8-4181-4cdd-a3d3-00863cf3bf70 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Request method failure captured: Apr 18 09:15:28 user devstack@n-api.service[61594]: request: GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8 HTTP/1.1 Apr 18 09:15:28 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:15:28 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:15:28 user devstack@n-api.service[61594]: Connection: close Apr 18 09:15:28 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:15:28 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:15:28 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:15:28 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:15:28 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl-vnl49BquWqzJFJ81AV3X3zGipva5hwBTWB2jsFZP4oL4JHSGlsFMpf16UUwOalkDKJH-U-K_Oy_nHuCUex7fPHF-A2QxWzEYEswa4PqEflqk6dS9r-tnFV-KMiNqi-ttzUN9sqw3sYSSYAXYR_S2MgHWlmEefqt459lOXzRiufYU Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Project-Id: 74cac557b926433db594032ae3727144 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Project-Name: tempest-VolumesGetTestJSON-1690234561 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/74cac557b926433db594032ae3727144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/74cac557b926433db594032ae3727144"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/74cac557b926433db594032ae3727144"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Tenant: tempest-VolumesGetTestJSON-1690234561 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Tenant-Id: 74cac557b926433db594032ae3727144 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-VolumesGetTestJSON-1690234561 Apr 18 09:15:28 user devstack@n-api.service[61594]: X-User: tempest-VolumesGetTestJSON-1690234561-project-member Apr 18 09:15:28 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:15:28 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:15:28 user devstack@n-api.service[61594]: X-User-Id: fa9c3afa32034d6785efa1b53af64f5a Apr 18 09:15:28 user devstack@n-api.service[61594]: X-User-Name: tempest-VolumesGetTestJSON-1690234561-project-member Apr 18 09:15:28 user devstack@n-api.service[61594]: method: Apr 18 09:15:28 user devstack@n-api.service[61594]: exception: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. Apr 18 09:15:28 user devstack@n-api.service[61594]: action_args: {'id': '06f573e5-ccfe-4a11-b864-38f78a38d7c8'} Apr 18 09:15:28 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. (HTTP 404) (Request-ID: req-a43e4a6e-8276-4f84-a6c3-650b654ea594) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. Apr 18 09:15:28 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:15:28 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-5239e1b8-4181-4cdd-a3d3-00863cf3bf70 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] Returning 404 to user: Volume 06f573e5-ccfe-4a11-b864-38f78a38d7c8 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:15:28 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-5239e1b8-4181-4cdd-a3d3-00863cf3bf70 tempest-VolumesGetTestJSON-1690234561 tempest-VolumesGetTestJSON-1690234561-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8" status: 404 len: 109 microversion: 2.1 time: 0.044440 Apr 18 09:15:28 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 78/234] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 09:15:28 2023] GET /compute/v2.1/os-volumes/06f573e5-ccfe-4a11-b864-38f78a38d7c8 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-2dca919f-064d-45db-892b-a41c7a5e17db tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.164917 Apr 18 09:15:44 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 78/235] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:15:44 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9/os-interface => generated 283 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:45 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-6b99d27f-a351-4746-a1d1-6354d8ec2225 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.394753 Apr 18 09:15:45 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:44 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:45 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d938e5a4-f464-41c7-b9d3-3231165408e0 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.298799 Apr 18 09:15:45 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 79/237] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:45 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:45 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-5d9edad2-9ced-46aa-bd58-6cbfc08a4341 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.218369 Apr 18 09:15:45 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:45 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-e6906f25-2307-4a1a-b371-b0d09de96342 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9/ips" status: 200 len: 109 microversion: 2.1 time: 0.042936 Apr 18 09:15:45 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:15:45 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:45 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:45 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:45 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:45 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:45 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] Creating event network-changed:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:45 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-06792817-ace2-4215-a96b-4afe4866d480 req-4ffd9b29-4cda-4079-a24b-5e281a823e5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133917 Apr 18 09:15:45 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 81/240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:47 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:15:47 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-d432f233-0cc7-446e-b12f-547fdb01928d tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 204 len: 0 microversion: 2.1 time: 0.144231 Apr 18 09:15:47 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 80/241] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:15:47 2023] DELETE /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:47 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-4c65bc38-0c4a-4141-a38d-7be006f824e8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 200 len: 1672 microversion: 2.1 time: 0.173967 Apr 18 09:15:47 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:15:47 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:47 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-unplugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] Creating event network-vif-unplugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-8db37d40-5d74-4548-8886-4d1c8d47004e req-470adfe6-3348-407c-b93e-4b0cb4c00a5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030623 Apr 18 09:15:47 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:48 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-62264527", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "destination_type": "volume"}], "networks": [{"uuid": "8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e"}]}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:48 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] validate_networks() for [('8b85d2bc-280c-44a4-92fe-a9f5b9b6b06e', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Getting quotas for user 570a82a0281445b2a7bb2fc9d07342d3 and project 96fb7fa381004461936ab66be0403012. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:15:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:15:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-674879eb-b8d7-4a15-b56f-aa1feb4abfe4 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.112143 Apr 18 09:15:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 81/244] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:15:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 09:15:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:15:49 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:15:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}, {"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}, {"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}, {"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-unplugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}, {"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-plugged", "status": "completed", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}, {"server_uuid": "c3b635b6-2954-46b1-a6a7-a1f7fe067fc9", "name": "network-vif-deleted", "tag": "89d5faea-6e35-46ac-8cae-7eeb5bb553cc"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-unplugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-plugged:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] Creating event network-vif-deleted:89d5faea-6e35-46ac-8cae-7eeb5bb553cc for instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 on user Apr 18 09:15:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-9d041338-95e3-4af5-91f4-87c492a721c3 req-c71f805e-89ec-4229-a34a-bf3b072e502b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.032420 Apr 18 09:15:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:15:49 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:49 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:15:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-4fdfdd54-f632-4a10-8188-9885750954e7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6" status: 200 len: 1393 microversion: 2.87 time: 0.083824 Apr 18 09:15:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 82/246] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:15:49 2023] GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6 => generated 1393 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:15:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29544713-147a-48d3-b97e-c9cc6815cae6", "tag": "b4f48473-8f22-4eaf-88c9-87804ac93101"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] Creating event network-changed:b4f48473-8f22-4eaf-88c9-87804ac93101 for instance 29544713-147a-48d3-b97e-c9cc6815cae6 on user Apr 18 09:15:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-7b06ff05-7697-4f0d-a458-4504fc8263ac req-67fdf2eb-e976-4914-b8b9-48157e22c5f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028614 Apr 18 09:15:52 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 82/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:15:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29544713-147a-48d3-b97e-c9cc6815cae6", "name": "network-vif-deleted", "tag": "b4f48473-8f22-4eaf-88c9-87804ac93101"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:15:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:15:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:15:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:15:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.compute.server_external_events [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] Unable to find a host for instance 29544713-147a-48d3-b97e-c9cc6815cae6. Dropping event network-vif-deleted {{(pid=61592) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 09:15:54 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-532bb326-e9ea-4408-a3f9-892c2410d109 req-b306e865-e8cf-415e-8434-601aa340bb5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024527 Apr 18 09:15:54 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 84/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:15:54 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=16 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=12 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:15 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:16:15 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9a938731-e581-4b38-ac05-587af8bc3dec tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17" status: 204 len: 0 microversion: 2.1 time: 0.119729 Apr 18 09:16:15 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 83/249] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:16:15 2023] DELETE /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "name": "network-vif-unplugged", "status": "completed", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=10 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=14 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:15 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:15 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-b7f7ccb8-bc7b-435c-afa0-92635211bad6 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17" status: 200 len: 1502 microversion: 2.1 time: 0.248590 Apr 18 09:16:15 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 83/250] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:16:15 2023] GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:16:15 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] Creating event network-vif-unplugged:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:16:15 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-b1abe733-6751-43e0-a519-22942fa8070d req-eb4efc48-241a-49c2-a49b-298960c973db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045768 Apr 18 09:16:15 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:17 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "name": "network-vif-plugged", "status": "completed", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}, {"server_uuid": "8c6f8351-1396-454a-ae5f-3be9a7e41a17", "name": "network-vif-deleted", "tag": "62fc6295-559b-4b5b-92ee-f067297c3e17"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:17 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:17 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:17 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:17 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Creating event network-vif-plugged:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:16:17 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] Creating event network-vif-deleted:62fc6295-559b-4b5b-92ee-f067297c3e17 for instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 on user Apr 18 09:16:17 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-d4a4d26e-0349-4e1e-a05f-606aa495e78f req-cabc7b56-e53d-4fd9-8804-7274c255e4fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034095 Apr 18 09:16:17 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:24 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:24 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-7c173cbb-6d25-494e-8e2f-5e1c3a4915e4 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1494 microversion: 2.1 time: 0.218697 Apr 18 09:16:24 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 84/253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:16:24 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1494 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:37 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:16:37 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 HTTP/1.1 Apr 18 09:16:37 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:16:37 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:16:37 user devstack@n-api.service[61592]: Connection: close Apr 18 09:16:37 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:16:37 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:16:37 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:16:37 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:16:37 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:16:37 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:16:37 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:16:37 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:16:37 user devstack@n-api.service[61592]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:16:37 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:16:37 user devstack@n-api.service[61592]: method: > Apr 18 09:16:37 user devstack@n-api.service[61592]: exception: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:16:37 user devstack@n-api.service[61592]: action_args: {'id': 'c3b635b6-2954-46b1-a6a7-a1f7fe067fc9'} Apr 18 09:16:37 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:16:37 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:16:37 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:16:37 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-4aa46fe4-51c1-4e5a-9220-ef7d9b0b3fdd tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 404 len: 111 microversion: 2.1 time: 0.034307 Apr 18 09:16:37 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:16:37 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:16:37 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:37 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-afd50186-73ee-4665-91e0-f7883dd6aed4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '.version_select at 0x7f0dce75ab90>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-afd50186-73ee-4665-91e0-f7883dd6aed4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493960909" status: 202 len: 0 microversion: 2.1 time: 0.031396 Apr 18 09:16:37 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:16:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493960909 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:16:38 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-4a9376bc-5973-4595-8fad-6bc22ab7e5a5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: .version_select at 0x7f0dce63e710>, body: {"keypair": {"name": "tempest-keypair-934236097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQDB7iGpJS3Q37t1Rgd2YiVDQ2JvA+sjFROzysHN3qNWFe9sUHlmtHwlQxT8n4jIB3Uu8qNHFIG2wV+hFTgl94AyzHttuFCIVLkRttffQazh2M2H6OYaTJrIDCJFxd9LQ=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:38 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:38 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=12 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:16:38 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-4a9376bc-5973-4595-8fad-6bc22ab7e5a5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:16:38 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-4a9376bc-5973-4595-8fad-6bc22ab7e5a5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:16:38 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-4a9376bc-5973-4595-8fad-6bc22ab7e5a5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052732 Apr 18 09:16:38 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 85/256] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:16:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1538707559", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c6b7356-c8ef-4d0d-b7c2-d96b8d362842"}], "security_groups": [{"name": "tempest-securitygroup--1392774576"}], "key_name": "tempest-keypair-934236097", "user_data": "}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:39 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] validate_networks() for [('4c6b7356-c8ef-4d0d-b7c2-d96b8d362842', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:39 user devstack@n-api.service[61594]: DEBUG nova.objects.instance [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lazy-loading 'fault' on Instance uuid 29544713-147a-48d3-b97e-c9cc6815cae6 {{(pid=61594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-05233157-562b-44c2-8646-9f0c4cce3680 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6" status: 200 len: 1648 microversion: 2.87 time: 0.123030 Apr 18 09:16:40 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 86/257] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:16:39 2023] GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6 => generated 1648 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Doing local delete in cell 82f4d1d5-971d-40da-bb81-ed51efeb387d(cell1) {{(pid=61593) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61593]: WARNING nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] instance's host None is down, deleting from database Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] deallocate_for_instance() {{(pid=61593) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Instance cache missing network info. {{(pid=61593) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Updating instance_info_cache with network_info: [] {{(pid=61593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61593) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 09:16:40 user devstack@n-api.service[61593]: WARNING nova.compute.api [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:16:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-260f7d66-dbfc-4b4e-ae20-ec6b3897bc0f tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6" status: 204 len: 0 microversion: 2.87 time: 0.330913 Apr 18 09:16:40 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 86/258] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:16:40 2023] DELETE /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 29544713-147a-48d3-b97e-c9cc6815cae6] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-4e3cfacb-1894-4139-bd1e-5c4c05675650 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.659030 Apr 18 09:16:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:16:39 2023] POST /compute/v2.1/servers => generated 400 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] HTTP exception thrown: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Request method failure captured: Apr 18 09:16:40 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6 HTTP/1.1 Apr 18 09:16:40 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:16:40 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:16:40 user devstack@n-api.service[61594]: Connection: close Apr 18 09:16:40 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:16:40 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:16:40 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:16:40 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:16:40 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4piJD8yF_P4GtIQoY5wZGTBQNnRtBYMuxQQ8L1vOYPpGOOuCFFlV_oiaSOAbFjrGYs4fQ5B8N1LZF0Zc57_iRwRTJ1Ny-fZjkVc29uUG4gntz9qFBt6gprMsjXD_zUNTkQuJPX_LogdpDsKIzKPncazkMG377jZNgLN38PjIW5N6c Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Project-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96fb7fa381004461936ab66be0403012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Tenant-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:16:40 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:16:40 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:16:40 user devstack@n-api.service[61594]: X-User-Id: 570a82a0281445b2a7bb2fc9d07342d3 Apr 18 09:16:40 user devstack@n-api.service[61594]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:16:40 user devstack@n-api.service[61594]: method: > Apr 18 09:16:40 user devstack@n-api.service[61594]: exception: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. Apr 18 09:16:40 user devstack@n-api.service[61594]: action_args: {'id': '29544713-147a-48d3-b97e-c9cc6815cae6'} Apr 18 09:16:40 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. Apr 18 09:16:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Returning 404 to user: Instance 29544713-147a-48d3-b97e-c9cc6815cae6 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:16:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-02ce30ee-d1c8-42a7-8b69-f068828017b2 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6" status: 404 len: 111 microversion: 2.87 time: 0.027025 Apr 18 09:16:40 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 87/260] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:16:40 2023] GET /compute/v2.1/servers/29544713-147a-48d3-b97e-c9cc6815cae6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-8cc7786b-6b60-4426-b7fc-6717938e861c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-8cc7786b-6b60-4426-b7fc-6717938e861c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:40 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-8cc7786b-6b60-4426-b7fc-6717938e861c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-8cc7786b-6b60-4426-b7fc-6717938e861c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 200 len: 1235 microversion: 2.1 time: 0.065153 Apr 18 09:16:40 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 87/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:16:40 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 1235 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:16:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-9eaf9958-0173-43fd-b39d-308279ce00d7 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 204 len: 0 microversion: 2.87 time: 0.127225 Apr 18 09:16:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 88/262] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:16:40 2023] DELETE /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:41 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:41 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:41 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:41 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-372e6399-f49a-4c3b-b1d2-22827fe36ea3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 200 len: 1698 microversion: 2.87 time: 0.244471 Apr 18 09:16:41 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:16:40 2023] GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 1698 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:16:41 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "name": "network-vif-unplugged", "status": "completed", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:41 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] Creating event network-vif-unplugged:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:16:41 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-16c09f46-fb85-4b84-9d14-793fd307e953 req-be7c5313-5091-4c6e-80f5-69d4c74bec6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041960 Apr 18 09:16:41 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 88/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:42 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "name": "network-vif-deleted", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] Creating event network-vif-deleted:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:16:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-8ec791cc-b4ce-4972-9354-83f7ada890ab req-fdf61615-ab0c-40e3-b520-63be1f39a802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027908 Apr 18 09:16:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:43 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e921e0-b70d-4a77-8617-e97551c8d66f", "name": "network-vif-plugged", "status": "completed", "tag": "64d4a631-31b5-4650-980f-84fdfca7a099"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:43 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:43 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] Creating event network-vif-plugged:64d4a631-31b5-4650-980f-84fdfca7a099 for instance 58e921e0-b70d-4a77-8617-e97551c8d66f on user Apr 18 09:16:43 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-ca1690a2-a5a5-463a-bbe8-21b458dbc97d req-3d65ef64-e403-47ef-86b5-b3c4d5012541 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Apr 18 09:16:43 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:44 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] Creating event network-changed:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:16:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-005ed993-750d-4450-b058-aa9859e0bb65 req-1d732f35-5ca0-4c4f-a00f-1d334ba0bcb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027859 Apr 18 09:16:44 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 89/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:46 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "name": "network-vif-plugged", "status": "completed", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}, {"server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "name": "network-vif-plugged", "status": "completed", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:16:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Creating event network-vif-plugged:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:16:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] Creating event network-vif-plugged:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:16:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-9aad5849-7b8d-449c-b2c7-7f28a469801f req-37b9c267-ad53-4626-8b07-e54ddafc41a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030444 Apr 18 09:16:46 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:16:47 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:16:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-b3f3fc4d-17a4-4c8b-9079-813666d6035c tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1656 microversion: 2.1 time: 0.229234 Apr 18 09:16:47 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:16:47 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1656 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: 8c6f8351-1396-454a-ae5f-3be9a7e41a17] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] HTTP exception thrown: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. Apr 18 09:17:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Request method failure captured: Apr 18 09:17:06 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 HTTP/1.1 Apr 18 09:17:06 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:17:06 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:17:06 user devstack@n-api.service[61593]: Connection: close Apr 18 09:17:06 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:17:06 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:17:06 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:17:06 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:17:06 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl71tD9A-J6QHHTGa8ZGzkgG2xELnP_zfThvFUeKo0qQQ915l8ASLfanyubofwpVtltA77vJN4bHueLopONgaowiNuql-te5z6QxxOhdaRJyn8oOqklJ-87SaKH8dAeXV3k0msxua8_CPcV-Fv2wA_b3vb79TZjza26zVEveU3O9lTg Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Project-Id: 525646a9754f4dad81b0a412092eedba Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Project-Name: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/525646a9754f4dad81b0a412092eedba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/525646a9754f4dad81b0a412092eedba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/525646a9754f4dad81b0a412092eedba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Tenant: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Tenant-Id: 525646a9754f4dad81b0a412092eedba Apr 18 09:17:06 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:06 user devstack@n-api.service[61593]: X-User: tempest-VolumesAdminNegativeTest-609430088-project-member Apr 18 09:17:06 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:17:06 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:17:06 user devstack@n-api.service[61593]: X-User-Id: 11696f31237843129128e4a6d13703cc Apr 18 09:17:06 user devstack@n-api.service[61593]: X-User-Name: tempest-VolumesAdminNegativeTest-609430088-project-member Apr 18 09:17:06 user devstack@n-api.service[61593]: method: > Apr 18 09:17:06 user devstack@n-api.service[61593]: exception: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. Apr 18 09:17:06 user devstack@n-api.service[61593]: action_args: {'id': '8c6f8351-1396-454a-ae5f-3be9a7e41a17'} Apr 18 09:17:06 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. Apr 18 09:17:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Returning 404 to user: Instance 8c6f8351-1396-454a-ae5f-3be9a7e41a17 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:17:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c2651efa-7258-469d-854e-fe7ae4227558 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17" status: 404 len: 111 microversion: 2.1 time: 0.042093 Apr 18 09:17:06 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 90/270] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:05 2023] GET /compute/v2.1/servers/8c6f8351-1396-454a-ae5f-3be9a7e41a17 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:06 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:17:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-993e9bff-364e-472c-acfe-4c5a950f8732 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8" status: 204 len: 0 microversion: 2.1 time: 0.258045 Apr 18 09:17:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:17:06 2023] DELETE /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=24 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:06 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11696f31237843129128e4a6d13703cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '525646a9754f4dad81b0a412092eedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-2b535af5-e290-46f0-8b61-decabd6ac514 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8" status: 200 len: 1669 microversion: 2.1 time: 0.243668 Apr 18 09:17:06 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 91/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:06 2023] GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 => generated 1669 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:17:07 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "name": "network-vif-unplugged", "status": "completed", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:07 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:07 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] Creating event network-vif-unplugged:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:17:07 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-3c94a395-2d19-4310-8dec-397852899cf5 req-e4a86826-65a9-44e5-ba2f-086192ed8354 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028017 Apr 18 09:17:07 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 91/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:07 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "name": "network-vif-deleted", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:07 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:07 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] Creating event network-vif-deleted:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:17:07 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-8c49c684-25c5-4a0c-bc32-3cb25da22e56 req-aa1d0691-f1ce-448f-a2bf-052996d748c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033112 Apr 18 09:17:07 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:09 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47904d9-afd8-48ec-99e5-3899923098b8", "name": "network-vif-plugged", "status": "completed", "tag": "11f35864-da9d-4a7f-9455-8538f3920a6d"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:09 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:09 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:09 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:09 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] Creating event network-vif-plugged:11f35864-da9d-4a7f-9455-8538f3920a6d for instance e47904d9-afd8-48ec-99e5-3899923098b8 on user Apr 18 09:17:09 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-df0721b7-e2c4-4af3-b09d-f6929f010893 req-d68de2ad-a339-482e-b4f0-1c82abdab498 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027731 Apr 18 09:17:09 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] HTTP exception thrown: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Request method failure captured: Apr 18 09:17:25 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a HTTP/1.1 Apr 18 09:17:25 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:17:25 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:17:25 user devstack@n-api.service[61593]: Connection: close Apr 18 09:17:25 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:17:25 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:17:25 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:17:25 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:17:25 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4d-9CPLeRSeNDxo4UbcSTW2ewMl0mzLzA_flE3EAQLC4YIwOPFQWrO9fzuV4h-20uap8H60l5cTZicZRBTNRlEWhCWEyrJmFwuxz-lATVwPhUGQlZGcEpzjkNJi6toniObPhocNYwrYJ875yVL1AFRuQpWSJZoJp1JBXXvCQu-wOw Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Project-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Project-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Tenant: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Tenant-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-User: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:17:25 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:17:25 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:17:25 user devstack@n-api.service[61593]: X-User-Id: bbf3c3dde757444d9ca4f5e395cd3da7 Apr 18 09:17:25 user devstack@n-api.service[61593]: X-User-Name: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:17:25 user devstack@n-api.service[61593]: method: > Apr 18 09:17:25 user devstack@n-api.service[61593]: exception: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61593]: action_args: {'id': '6f130904-8f2d-4bb8-be04-49ccc9cfeb4a'} Apr 18 09:17:25 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Returning 404 to user: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:17:25 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-6abc8c2b-5504-46b1-8a84-e856fdabdd99 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 404 len: 111 microversion: 2.1 time: 0.034210 Apr 18 09:17:25 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 92/276] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:17:25 2023] DELETE /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] HTTP exception thrown: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Request method failure captured: Apr 18 09:17:25 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a HTTP/1.1 Apr 18 09:17:25 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:17:25 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:17:25 user devstack@n-api.service[61592]: Connection: close Apr 18 09:17:25 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:17:25 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:17:25 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:17:25 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:17:25 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4d-9CPLeRSeNDxo4UbcSTW2ewMl0mzLzA_flE3EAQLC4YIwOPFQWrO9fzuV4h-20uap8H60l5cTZicZRBTNRlEWhCWEyrJmFwuxz-lATVwPhUGQlZGcEpzjkNJi6toniObPhocNYwrYJ875yVL1AFRuQpWSJZoJp1JBXXvCQu-wOw Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Project-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Project-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Tenant: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Tenant-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-User: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:17:25 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:17:25 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:17:25 user devstack@n-api.service[61592]: X-User-Id: bbf3c3dde757444d9ca4f5e395cd3da7 Apr 18 09:17:25 user devstack@n-api.service[61592]: X-User-Name: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:17:25 user devstack@n-api.service[61592]: method: > Apr 18 09:17:25 user devstack@n-api.service[61592]: exception: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61592]: action_args: {'id': '6f130904-8f2d-4bb8-be04-49ccc9cfeb4a'} Apr 18 09:17:25 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. Apr 18 09:17:25 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Returning 404 to user: Instance 6f130904-8f2d-4bb8-be04-49ccc9cfeb4a could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:17:25 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-9ae609e7-141e-492d-8e0c-b4f6f2cfd953 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a" status: 404 len: 111 microversion: 2.1 time: 0.038563 Apr 18 09:17:25 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:25 2023] GET /compute/v2.1/servers/6f130904-8f2d-4bb8-be04-49ccc9cfeb4a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=8 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:17:25 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-fe99914e-ed86-4f38-9919-ac7151323c57 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 204 len: 0 microversion: 2.1 time: 0.125920 Apr 18 09:17:25 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 93/278] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:17:25 2023] DELETE /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "name": "network-vif-unplugged", "status": "completed", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:25 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:25 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] Creating event network-vif-unplugged:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:17:25 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-c9aca004-e8e5-4f4e-b5c2-ebb16695723b req-837f0633-2529-4ae5-8c35-2f112fd41602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031596 Apr 18 09:17:25 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 94/279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:25 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf3c3dde757444d9ca4f5e395cd3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eca30bdd994c46b19be2f7194e179669', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:25 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-e9b49cdf-e8a7-411d-8f93-8befab16e506 tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 200 len: 1500 microversion: 2.1 time: 0.437714 Apr 18 09:17:25 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 93/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:25 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 1500 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:17:26 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "name": "network-vif-deleted", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] Creating event network-vif-deleted:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:17:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-5942bc50-2511-4c69-9964-df3f7c2e072a req-38812eb1-35a2-4e08-8ee0-dc866bab2625 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Apr 18 09:17:26 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 94/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:17:27 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d791f54b-fcc4-4ae1-bc5f-d1c562d85693", "name": "network-vif-plugged", "status": "completed", "tag": "2dcd093f-c3a8-45ad-af2e-bdd5712dc740"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] Creating event network-vif-plugged:2dcd093f-c3a8-45ad-af2e-bdd5712dc740 for instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 on user Apr 18 09:17:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-dafedb15-fc6e-4e23-a159-283f45463f91 req-9b4ebae9-7658-41c8-b126-e6115b976a17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027308 Apr 18 09:17:27 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:30 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-978768c8-a7b5-48a3-8a87-064cf95cd513 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 200 len: 1545 microversion: 2.1 time: 0.240935 Apr 18 09:17:30 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 94/283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:30 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 1545 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 58e921e0-b70d-4a77-8617-e97551c8d66f] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] HTTP exception thrown: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Request method failure captured: Apr 18 09:17:31 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f HTTP/1.1 Apr 18 09:17:31 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:17:31 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:17:31 user devstack@n-api.service[61594]: Connection: close Apr 18 09:17:31 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:17:31 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:17:31 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:17:31 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:17:31 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl4piJD8yF_P4GtIQoY5wZGTBQNnRtBYMuxQQ8L1vOYPpGOOuCFFlV_oiaSOAbFjrGYs4fQ5B8N1LZF0Zc57_iRwRTJ1Ny-fZjkVc29uUG4gntz9qFBt6gprMsjXD_zUNTkQuJPX_LogdpDsKIzKPncazkMG377jZNgLN38PjIW5N6c Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Project-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96fb7fa381004461936ab66be0403012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Tenant-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:17:31 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:17:31 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:17:31 user devstack@n-api.service[61594]: X-User-Id: 570a82a0281445b2a7bb2fc9d07342d3 Apr 18 09:17:31 user devstack@n-api.service[61594]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:17:31 user devstack@n-api.service[61594]: method: > Apr 18 09:17:31 user devstack@n-api.service[61594]: exception: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. Apr 18 09:17:31 user devstack@n-api.service[61594]: action_args: {'id': '58e921e0-b70d-4a77-8617-e97551c8d66f'} Apr 18 09:17:31 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. Apr 18 09:17:31 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Returning 404 to user: Instance 58e921e0-b70d-4a77-8617-e97551c8d66f could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:17:31 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-39908f83-4725-4d64-bce7-fc907b776237 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f" status: 404 len: 111 microversion: 2.87 time: 0.032207 Apr 18 09:17:31 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:17:31 2023] GET /compute/v2.1/servers/58e921e0-b70d-4a77-8617-e97551c8d66f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:17:31 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-b5dffc92-085d-4454-9d9f-9221c41a2969 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 204 len: 0 microversion: 2.87 time: 0.103693 Apr 18 09:17:31 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 96/285] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:17:31 2023] DELETE /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:31 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570a82a0281445b2a7bb2fc9d07342d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96fb7fa381004461936ab66be0403012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-1fe21fa0-f264-40e6-92e3-f2195459f145 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 200 len: 1697 microversion: 2.87 time: 0.244960 Apr 18 09:17:31 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 95/286] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:17:31 2023] GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 1697 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "name": "network-vif-unplugged", "status": "completed", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:31 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] Creating event network-vif-unplugged:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:17:31 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-0562e050-cca2-42d4-b43e-49e564ac8d23 req-c8afbae5-a67f-4695-b855-b63c4b4575f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030656 Apr 18 09:17:31 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 96/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "name": "network-vif-deleted", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] Creating event network-vif-deleted:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:17:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-ce94e969-b54c-4a8f-af36-4c528feb8173 req-2df1fabe-f540-42d5-9e2e-80ab6dbbf44d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 Apr 18 09:17:32 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:33 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5864d758-92e4-405c-b43c-9ec7cbbaaa6f", "name": "network-vif-plugged", "status": "completed", "tag": "4ac4cde8-c063-4256-b131-753916a57a1b"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:33 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] Creating event network-vif-plugged:4ac4cde8-c063-4256-b131-753916a57a1b for instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f on user Apr 18 09:17:33 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-9cd0604d-f346-4589-8c02-fc97666b7990 req-aaa2af78-fbdd-4173-a5e1-91e30b6c734a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031112 Apr 18 09:17:33 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:48 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:17:48 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ce238780-027e-4a80-9362-eb39fef650eb tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 204 len: 0 microversion: 2.1 time: 0.112827 Apr 18 09:17:48 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 97/290] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:17:48 2023] DELETE /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:48 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df17b369f8e842baaee174ac9f84181e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8365dfe289f64b8296757c92d85d47e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:17:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-5da1d5ea-a555-43cf-8f8d-7e5e5556d231 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 200 len: 1662 microversion: 2.1 time: 0.654721 Apr 18 09:17:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:48 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 1662 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=12 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=22 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "name": "network-vif-unplugged", "status": "completed", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] Creating event network-vif-unplugged:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:17:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-579edda2-7eb1-4c7f-9897-e4ae88c2704e req-b3f7a8d2-4cf8-4bfa-b2ac-479518bd3e67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032277 Apr 18 09:17:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 97/292] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:50 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "name": "network-vif-deleted", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:50 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:50 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] Creating event network-vif-deleted:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:17:50 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-edb0e357-b73c-4f47-978b-b622c7ba82f2 req-2688b274-e94c-4d97-ad0f-e84f6ccee02e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028147 Apr 18 09:17:50 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 98/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:51 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e79722-87bd-431c-abe5-5549be54ef85", "name": "network-vif-plugged", "status": "completed", "tag": "3d5bda5b-910c-4156-82ef-46292cdcd5ec"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:17:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:51 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] Creating event network-vif-plugged:3d5bda5b-910c-4156-82ef-46292cdcd5ec for instance 43e79722-87bd-431c-abe5-5549be54ef85 on user Apr 18 09:17:51 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-c69d1457-4407-46ab-99a9-a690593e87f5 req-ae45a26f-5e5f-431d-809f-d885e46aa6fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Apr 18 09:17:51 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] [instance: e47904d9-afd8-48ec-99e5-3899923098b8] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:17:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] HTTP exception thrown: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Request method failure captured: Apr 18 09:17:56 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 HTTP/1.1 Apr 18 09:17:56 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:17:56 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:17:56 user devstack@n-api.service[61593]: Connection: close Apr 18 09:17:56 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:17:56 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:17:56 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:17:56 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:17:56 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl71tD9A-J6QHHTGa8ZGzkgG2xELnP_zfThvFUeKo0qQQ915l8ASLfanyubofwpVtltA77vJN4bHueLopONgaowiNuql-te5z6QxxOhdaRJyn8oOqklJ-87SaKH8dAeXV3k0msxua8_CPcV-Fv2wA_b3vb79TZjza26zVEveU3O9lTg Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Project-Id: 525646a9754f4dad81b0a412092eedba Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Project-Name: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/525646a9754f4dad81b0a412092eedba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/525646a9754f4dad81b0a412092eedba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/525646a9754f4dad81b0a412092eedba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Tenant: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Tenant-Id: 525646a9754f4dad81b0a412092eedba Apr 18 09:17:56 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-609430088 Apr 18 09:17:56 user devstack@n-api.service[61593]: X-User: tempest-VolumesAdminNegativeTest-609430088-project-member Apr 18 09:17:56 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:17:56 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:17:56 user devstack@n-api.service[61593]: X-User-Id: 11696f31237843129128e4a6d13703cc Apr 18 09:17:56 user devstack@n-api.service[61593]: X-User-Name: tempest-VolumesAdminNegativeTest-609430088-project-member Apr 18 09:17:56 user devstack@n-api.service[61593]: method: > Apr 18 09:17:56 user devstack@n-api.service[61593]: exception: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. Apr 18 09:17:56 user devstack@n-api.service[61593]: action_args: {'id': 'e47904d9-afd8-48ec-99e5-3899923098b8'} Apr 18 09:17:56 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. Apr 18 09:17:56 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:17:56 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Returning 404 to user: Instance e47904d9-afd8-48ec-99e5-3899923098b8 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:17:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-3382d731-9fb0-408b-b038-fd91aa513479 tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8" status: 404 len: 111 microversion: 2.1 time: 0.184084 Apr 18 09:17:56 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 98/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:17:56 2023] GET /compute/v2.1/servers/e47904d9-afd8-48ec-99e5-3899923098b8 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:17:56 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a133d5cb-0d16-458f-9be3-dc65485d904a tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] Calling method '.version_select at 0x7f0dce759870>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:17:56 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-a133d5cb-0d16-458f-9be3-dc65485d904a tempest-VolumesAdminNegativeTest-609430088 tempest-VolumesAdminNegativeTest-609430088-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862665852" status: 202 len: 0 microversion: 2.1 time: 0.020578 Apr 18 09:17:56 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 99/296] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:17:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862665852 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=8 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-165938052", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "ecc4c001-3a23-465f-8f1a-25771ea286b7"}]}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] validate_networks() for [('ecc4c001-3a23-465f-8f1a-25771ea286b7', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Getting quotas for project bfa6a9dacd9f435792381cf297270399. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Getting quotas for user 2451f5c9181b45589ba98960c826a978 and project bfa6a9dacd9f435792381cf297270399. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:18:11 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:18:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-c1d18de0-7a40-4bae-ac03-2292d4179f51 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.677670 Apr 18 09:18:11 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 100/297] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:18:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:18:11 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-6c52a39f-720b-480e-94a0-844875ad9021 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:11 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-6c52a39f-720b-480e-94a0-844875ad9021 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:11 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:11 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:11 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-6c52a39f-720b-480e-94a0-844875ad9021 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2451f5c9181b45589ba98960c826a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa6a9dacd9f435792381cf297270399', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:18:11 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-6c52a39f-720b-480e-94a0-844875ad9021 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2" status: 200 len: 1208 microversion: 2.1 time: 0.065006 Apr 18 09:18:11 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:18:11 2023] GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 => generated 1208 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] Creating event network-changed:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:18:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-da8a92b8-8491-41aa-a0c2-d58bf9c49ac7 req-82317b20-5282-45ba-9579-994c1ba9bbc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059935 Apr 18 09:18:14 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 100/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:15 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "name": "network-vif-plugged", "status": "completed", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:15 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:15 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] Creating event network-vif-plugged:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:18:15 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-26fe81ec-3b0b-4975-862f-1e935d5fdf86 req-a55ab2ae-09ff-4122-927e-47f263a45e25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038956 Apr 18 09:18:15 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] [instance: d791f54b-fcc4-4ae1-bc5f-d1c562d85693] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:15 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:16 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] HTTP exception thrown: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. Apr 18 09:18:16 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Request method failure captured: Apr 18 09:18:16 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 HTTP/1.1 Apr 18 09:18:16 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:18:16 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:18:16 user devstack@n-api.service[61593]: Connection: close Apr 18 09:18:16 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:18:16 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:18:16 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:18:16 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:18:16 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl4d-9CPLeRSeNDxo4UbcSTW2ewMl0mzLzA_flE3EAQLC4YIwOPFQWrO9fzuV4h-20uap8H60l5cTZicZRBTNRlEWhCWEyrJmFwuxz-lATVwPhUGQlZGcEpzjkNJi6toniObPhocNYwrYJ875yVL1AFRuQpWSJZoJp1JBXXvCQu-wOw Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Project-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Project-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eca30bdd994c46b19be2f7194e179669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Tenant: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Tenant-Id: eca30bdd994c46b19be2f7194e179669 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-937293639 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-User: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:18:16 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:18:16 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:18:16 user devstack@n-api.service[61593]: X-User-Id: bbf3c3dde757444d9ca4f5e395cd3da7 Apr 18 09:18:16 user devstack@n-api.service[61593]: X-User-Name: tempest-ServersNegativeTestJSON-937293639-project-member Apr 18 09:18:16 user devstack@n-api.service[61593]: method: > Apr 18 09:18:16 user devstack@n-api.service[61593]: exception: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. Apr 18 09:18:16 user devstack@n-api.service[61593]: action_args: {'id': 'd791f54b-fcc4-4ae1-bc5f-d1c562d85693'} Apr 18 09:18:16 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. Apr 18 09:18:16 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:18:16 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] Returning 404 to user: Instance d791f54b-fcc4-4ae1-bc5f-d1c562d85693 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:18:16 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-228ef537-76e0-44a7-b0a9-1da9bce83b1a tempest-ServersNegativeTestJSON-937293639 tempest-ServersNegativeTestJSON-937293639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693" status: 404 len: 111 microversion: 2.1 time: 0.033992 Apr 18 09:18:16 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 100/301] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:18:15 2023] GET /compute/v2.1/servers/d791f54b-fcc4-4ae1-bc5f-d1c562d85693 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:18:17 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "name": "network-vif-plugged", "status": "completed", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:18 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:18 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:18 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:18 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] Creating event network-vif-plugged:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:18:18 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-b47f0774-5476-46d8-b33d-ec726ea1ecd0 req-9abe2d90-159a-49a4-909e-33afa6bdcc93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036598 Apr 18 09:18:18 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] [instance: 5864d758-92e4-405c-b43c-9ec7cbbaaa6f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:21 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] HTTP exception thrown: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Request method failure captured: Apr 18 09:18:21 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f HTTP/1.1 Apr 18 09:18:21 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:18:21 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:18:21 user devstack@n-api.service[61592]: Connection: close Apr 18 09:18:21 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:18:21 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:18:21 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:18:21 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:18:21 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4piJD8yF_P4GtIQoY5wZGTBQNnRtBYMuxQQ8L1vOYPpGOOuCFFlV_oiaSOAbFjrGYs4fQ5B8N1LZF0Zc57_iRwRTJ1Ny-fZjkVc29uUG4gntz9qFBt6gprMsjXD_zUNTkQuJPX_LogdpDsKIzKPncazkMG377jZNgLN38PjIW5N6c Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Project-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/96fb7fa381004461936ab66be0403012"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/96fb7fa381004461936ab66be0403012"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Tenant-Id: 96fb7fa381004461936ab66be0403012 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:18:21 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:18:21 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:18:21 user devstack@n-api.service[61592]: X-User-Id: 570a82a0281445b2a7bb2fc9d07342d3 Apr 18 09:18:21 user devstack@n-api.service[61592]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member Apr 18 09:18:21 user devstack@n-api.service[61592]: method: > Apr 18 09:18:21 user devstack@n-api.service[61592]: exception: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. Apr 18 09:18:21 user devstack@n-api.service[61592]: action_args: {'id': '5864d758-92e4-405c-b43c-9ec7cbbaaa6f'} Apr 18 09:18:21 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. Apr 18 09:18:21 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:21 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] Returning 404 to user: Instance 5864d758-92e4-405c-b43c-9ec7cbbaaa6f could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:18:21 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-417cd19e-af42-4a74-b06a-2cc8614834f3 tempest-ServerBootFromVolumeStableRescueTest-2082932427 tempest-ServerBootFromVolumeStableRescueTest-2082932427-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f" status: 404 len: 111 microversion: 2.87 time: 0.030916 Apr 18 09:18:21 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 102/303] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:18:21 2023] GET /compute/v2.1/servers/5864d758-92e4-405c-b43c-9ec7cbbaaa6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c6ca87bb-6666-4e6c-8014-78fd7a547477 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.570354 Apr 18 09:18:31 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 101/304] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:18:30 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c/os-interface => generated 282 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:31 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:31 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:32 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9c3ce8c2-384a-4159-ad33-d5ca144bd46e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Action: 'create', calling method: .version_select at 0x7f0dce75b880>, body: {"keypair": {"name": "tempest-keypair-647550027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyTw7vyyAmSwlBEtdOATtaFYkzfaGs+lkQTQ1v9zCCFJwQCkpi8F81lpad33mypYPRE75qlvzepgQ8Z58dAU+zwfVqDFAyxO9ZdAbKW++wtVvi2JjSklQxvxFsA89mwiA=="}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:32 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-9c3ce8c2-384a-4159-ad33-d5ca144bd46e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for project cf7d15e50d7341a28f5c8925441f9692. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:18:32 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-9c3ce8c2-384a-4159-ad33-d5ca144bd46e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for user 0cdd6ccedc1e455aa8815a441d298f44 and project cf7d15e50d7341a28f5c8925441f9692. Resources: {'key_pairs'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:18:32 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9c3ce8c2-384a-4159-ad33-d5ca144bd46e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.235982 Apr 18 09:18:32 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 102/305] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 09:18:31 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] Creating event network-changed:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:18:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-c686491f-fe98-4970-89df-da986faf7420 req-ea1174dc-e6c8-4a06-9dfa-98c52b9391e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044078 Apr 18 09:18:32 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 103/306] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:32 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:32 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0a3ff325-98bf-4c03-afee-c696497bc9e1 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c/ips" status: 200 len: 108 microversion: 2.1 time: 0.041334 Apr 18 09:18:32 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 102/307] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:18:32 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:33 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:18:33 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-4b5605a6-459f-44a9-9a00-6d3c9567b7ef tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 204 len: 0 microversion: 2.1 time: 0.111029 Apr 18 09:18:33 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:18:33 2023] DELETE /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:33 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-477881663", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2f5119a0-e2e0-49d6-9884-3ebb5b952bfd"}], "security_groups": [{"name": "tempest-securitygroup--378619842"}], "key_name": "tempest-keypair-647550027", "user_data": "}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] validate_networks() for [('2f5119a0-e2e0-49d6-9884-3ebb5b952bfd', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:18:34 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d60f29d6-74ad-4a59-9aa8-d628d389fcab tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 200 len: 1669 microversion: 2.1 time: 0.238773 Apr 18 09:18:34 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:18:33 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 1669 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:18:34 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "name": "network-vif-unplugged", "status": "completed", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}, {"server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "name": "network-vif-plugged", "status": "completed", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Creating event network-vif-unplugged:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:18:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] Creating event network-vif-plugged:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:18:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-1268b8a1-15ae-4bd6-a49a-58918a50eedf req-af3b57a5-b1fd-430c-b371-1149ac6d1006 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031828 Apr 18 09:18:34 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:34 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for project cf7d15e50d7341a28f5c8925441f9692. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for user 0cdd6ccedc1e455aa8815a441d298f44 and project cf7d15e50d7341a28f5c8925441f9692. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:18:34 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:18:34 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-37803626-5a7f-4683-beef-adabda09cd90 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.755661 Apr 18 09:18:34 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 103/311] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:18:33 2023] POST /compute/v2.1/servers => generated 399 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:18:34 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:18:34 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-9d42bfa4-459b-41c1-b542-ff4e59f0f69c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 200 len: 1274 microversion: 2.20 time: 0.063106 Apr 18 09:18:34 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 105/312] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:18:34 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 1274 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:18:36 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20791ca9-4ac4-4d58-9288-e0b9362b131c", "name": "network-vif-deleted", "tag": "621da736-641d-402f-9e86-b8a99aa01977"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:36 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:36 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:36 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:36 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] Creating event network-vif-deleted:621da736-641d-402f-9e86-b8a99aa01977 for instance 20791ca9-4ac4-4d58-9288-e0b9362b131c on user Apr 18 09:18:36 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-e9a2d153-bf3f-4a42-8f68-177b46157bb3 req-c94efb0f-e0f9-4830-99bf-c5b0a44fb432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030248 Apr 18 09:18:36 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:38 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:38 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:38 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:38 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:38 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] Creating event network-changed:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:18:38 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-3c3dfbbb-4038-43c2-80f9-e4991aedcc49 req-43485824-98a7-473c-8be1-40cc8a42ce4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030773 Apr 18 09:18:38 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 104/314] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] [instance: 43e79722-87bd-431c-abe5-5549be54ef85] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] HTTP exception thrown: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Request method failure captured: Apr 18 09:18:39 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 HTTP/1.1 Apr 18 09:18:39 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:18:39 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:18:39 user devstack@n-api.service[61592]: Connection: close Apr 18 09:18:39 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:18:39 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:18:39 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:18:39 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:18:39 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl4eiHVkud6IRmLFwwfZdjE9vsIywohWM7HunPcv4qCz2D6vj7d6CdK9MNQ8yRBu836Rooc-OdxootCb5wIBQIySNlWO4ENGP4MXvCUozuKJmpyzF7EKrR7mjiZWCaQNhKDtV89eRbuT9tdGovJAfu2yeczZc3CJRxIACywyFfCBBS0 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Project-Id: 8365dfe289f64b8296757c92d85d47e9 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Project-Name: tempest-ServerActionsTestJSON-1020679248 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8365dfe289f64b8296757c92d85d47e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8365dfe289f64b8296757c92d85d47e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8365dfe289f64b8296757c92d85d47e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Tenant: tempest-ServerActionsTestJSON-1020679248 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Tenant-Id: 8365dfe289f64b8296757c92d85d47e9 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-ServerActionsTestJSON-1020679248 Apr 18 09:18:39 user devstack@n-api.service[61592]: X-User: tempest-ServerActionsTestJSON-1020679248-project-member Apr 18 09:18:39 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:18:39 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:18:39 user devstack@n-api.service[61592]: X-User-Id: df17b369f8e842baaee174ac9f84181e Apr 18 09:18:39 user devstack@n-api.service[61592]: X-User-Name: tempest-ServerActionsTestJSON-1020679248-project-member Apr 18 09:18:39 user devstack@n-api.service[61592]: method: > Apr 18 09:18:39 user devstack@n-api.service[61592]: exception: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. Apr 18 09:18:39 user devstack@n-api.service[61592]: action_args: {'id': '43e79722-87bd-431c-abe5-5549be54ef85'} Apr 18 09:18:39 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. Apr 18 09:18:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:18:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Returning 404 to user: Instance 43e79722-87bd-431c-abe5-5549be54ef85 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:18:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-2e06c46d-e297-4d15-92bd-43c31f3e12bc tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85" status: 404 len: 111 microversion: 2.1 time: 0.035083 Apr 18 09:18:39 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:18:39 2023] GET /compute/v2.1/servers/43e79722-87bd-431c-abe5-5549be54ef85 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:18:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-690d0c03-d009-47ba-ab92-1a4f6ad335c3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] Calling method '.version_select at 0x7f0dce75bd00>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:18:39 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-690d0c03-d009-47ba-ab92-1a4f6ad335c3 tempest-ServerActionsTestJSON-1020679248 tempest-ServerActionsTestJSON-1020679248-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851106022" status: 202 len: 0 microversion: 2.1 time: 0.024250 Apr 18 09:18:39 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:18:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851106022 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:18:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "name": "network-vif-plugged", "status": "completed", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] Creating event network-vif-plugged:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:18:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-42518857-e51f-4946-b683-9c790b8c5886 req-9f13b23a-7d37-4627-bd18-952dcf1dc1eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Apr 18 09:18:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 105/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:18:41 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "name": "network-vif-plugged", "status": "completed", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:18:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:18:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:18:41 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:18:41 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] Creating event network-vif-plugged:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:18:41 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-13c95749-0c34-4d7d-811c-524a8425cb40 req-851250e6-d47d-4f58-9783-76969d108ac1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026926 Apr 18 09:18:41 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:02 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2451f5c9181b45589ba98960c826a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa6a9dacd9f435792381cf297270399', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:19:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-336df44e-1a42-4481-8e62-5f6249fa87e1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2" status: 200 len: 1490 microversion: 2.1 time: 0.423013 Apr 18 09:19:02 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:19:02 2023] GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 => generated 1490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=14 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:24 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:19:24 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c HTTP/1.1 Apr 18 09:19:24 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:19:24 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:19:24 user devstack@n-api.service[61593]: Connection: close Apr 18 09:19:24 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:19:24 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:19:24 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:19:24 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:19:24 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:19:24 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:19:24 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:19:24 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:19:24 user devstack@n-api.service[61593]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:19:24 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:19:24 user devstack@n-api.service[61593]: method: > Apr 18 09:19:24 user devstack@n-api.service[61593]: exception: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:19:24 user devstack@n-api.service[61593]: action_args: {'id': '20791ca9-4ac4-4d58-9288-e0b9362b131c'} Apr 18 09:19:24 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:19:24 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:19:24 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:19:24 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-2a9a9656-c457-4c8d-b83e-49489128f44c tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 404 len: 111 microversion: 2.1 time: 0.252574 Apr 18 09:19:24 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 106/320] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:19:24 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:19:24 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=12 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=12 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-480743d5-fa7c-4393-acf2-288a4d5fe523 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '.version_select at 0x7f0dce60b7f0>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:19:24 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-480743d5-fa7c-4393-acf2-288a4d5fe523 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934236097" status: 202 len: 0 microversion: 2.1 time: 0.025178 Apr 18 09:19:24 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 09:19:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934236097 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:24 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:25 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:19:25 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:19:25 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:19:25 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-c7736d4d-3f4c-49d1-95f9-516d00c382ce tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 200 len: 1585 microversion: 2.20 time: 0.344096 Apr 18 09:19:25 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 108/322] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:19:24 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 1585 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:19:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-bd3ec6b0-70a4-48c2-95dc-baa22db90446 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: .version_select at 0x7f0dce63fbe0>, body: {"keypair": {"name": "tempest-keypair-1027700054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOKq+loxskxtDXvrU+NoNkLBODLWJTlYTdSAcJOcclRuUPhbDKV3IIvexQoB8EuitBVqfaZ7RZuexxxuUPClpzsbrlPhfQX+Lkliej0irwMpRkLwA1824hA5MXNMyj0Hg=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:19:25 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-bd3ec6b0-70a4-48c2-95dc-baa22db90446 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:19:25 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-bd3ec6b0-70a4-48c2-95dc-baa22db90446 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:19:25 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-bd3ec6b0-70a4-48c2-95dc-baa22db90446 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048922 Apr 18 09:19:25 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 107/323] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:19:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1019976560", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c6b7356-c8ef-4d0d-b7c2-d96b8d362842"}], "security_groups": [{"name": "tempest-securitygroup--1122551184"}], "key_name": "tempest-keypair-1027700054", "user_data": "}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.network.neutron [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] validate_networks() for [('4c6b7356-c8ef-4d0d-b7c2-d96b8d362842', None, None, None, None, None)] {{(pid=61592) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image limits 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Flavor pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Image pref 0:0:0 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.virt.hardware [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Getting quotas for user bcb9c492b52a4a58b7b34b87f541f44e and project 4577b5b5e8d348018cf4ae386f17eae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Going to run 1 instances... {{(pid=61592) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:19:27 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:19:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-ab993424-bbc8-4e3d-9aad-040c6602ea04 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.851896 Apr 18 09:19:27 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 109/324] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:19:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:19:27 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-dbf1fe61-0f52-4c7e-8256-1b1b3a2bd5ed tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:19:27 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-dbf1fe61-0f52-4c7e-8256-1b1b3a2bd5ed tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:19:27 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-dbf1fe61-0f52-4c7e-8256-1b1b3a2bd5ed tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:19:27 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-dbf1fe61-0f52-4c7e-8256-1b1b3a2bd5ed tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 200 len: 1236 microversion: 2.1 time: 0.066336 Apr 18 09:19:27 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:19:27 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:19:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:19:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] Creating event network-changed:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:19:30 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-14bb1d0c-bd96-4d1e-84bb-656784cb55ed req-103e443e-9cca-4bb6-8faf-2381eea55182 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082426 Apr 18 09:19:30 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:19:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "name": "network-vif-plugged", "status": "completed", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:19:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] Creating event network-vif-plugged:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:19:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-231ad127-e054-483c-869f-ed526f769972 req-144e5c6e-2c3f-4e9e-9ca4-124a8e919b40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085810 Apr 18 09:19:32 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:19:34 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "name": "network-vif-plugged", "status": "completed", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:19:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:19:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:19:34 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:19:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] Creating event network-vif-plugged:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:19:34 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-be7fd90d-f797-41ce-af68-1de99907f842 req-36f38fcd-03c3-4afe-ac0d-8d65c61d4ba0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029085 Apr 18 09:19:34 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 110/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:04 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:20:04 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-f96f1929-40d2-41bf-b69b-599cd1c62fc7 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2" status: 204 len: 0 microversion: 2.1 time: 0.126984 Apr 18 09:20:04 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:20:04 2023] DELETE /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=8 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=8 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "name": "network-vif-unplugged", "status": "completed", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] Creating event network-vif-unplugged:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:20:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-6d6a1c33-89d2-4c94-be9b-b2bff1481413 req-dca4361e-cd0c-4ceb-844e-37e111162170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049986 Apr 18 09:20:04 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 111/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:04 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2451f5c9181b45589ba98960c826a978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa6a9dacd9f435792381cf297270399', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:20:04 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-7c159e5f-4b57-49e4-a835-5bb293d619d1 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2" status: 200 len: 1496 microversion: 2.1 time: 0.383171 Apr 18 09:20:04 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 111/331] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:20:04 2023] GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 => generated 1496 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:20:05 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "name": "network-vif-deleted", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:05 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:05 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] Creating event network-vif-deleted:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:20:05 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-dad056bb-ecd7-4963-a204-b4babf7f059d req-086f5e8d-8e31-49a0-be18-7ef93de1f779 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028042 Apr 18 09:20:05 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98169e44-f735-4d2d-a739-21a3f35ac2d2", "name": "network-vif-plugged", "status": "completed", "tag": "e9224802-a844-4d19-857a-8615e104eab0"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] Creating event network-vif-plugged:e9224802-a844-4d19-857a-8615e104eab0 for instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 on user Apr 18 09:20:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-3e8db8d4-cebd-483f-a812-289ce02d21c4 req-98e4e5b8-1cf3-452b-9ead-febc277f7399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028463 Apr 18 09:20:06 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 112/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:18 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:20:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-a2b1e4ef-224e-4c9e-b32a-80d59647501b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 200 len: 1546 microversion: 2.1 time: 0.229021 Apr 18 09:20:18 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:20:18 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:25 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:25 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-cdf767f4-588e-4c7e-b74b-5c7546903e7c tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.228808 Apr 18 09:20:25 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 111/335] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 09:20:25 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09/os-interface => generated 283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:26 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] Creating event network-changed:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:20:26 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-a4618926-6ce2-4fb0-a9f6-a2282ec1b5f4 req-2712c5e8-5b8a-488d-8de1-9aba59b1a609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034117 Apr 18 09:20:26 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:26 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:26 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-5b9b721f-964e-4956-8aeb-8802505633e1 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09/ips" status: 200 len: 110 microversion: 2.20 time: 0.036114 Apr 18 09:20:26 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 113/337] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 09:20:26 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09/ips => generated 110 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:27 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:20:27 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-4349eb77-1413-43e7-a5ec-e7a2c5f41c4f tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 204 len: 0 microversion: 2.20 time: 0.115559 Apr 18 09:20:27 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 112/338] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:20:27 2023] DELETE /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:20:27 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "name": "network-vif-unplugged", "status": "completed", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:20:27 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:20:27 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-2a4034aa-4c3c-4d0f-b899-ca128b3d7334 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 200 len: 1710 microversion: 2.20 time: 0.220621 Apr 18 09:20:27 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:20:27 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 1710 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:20:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] Creating event network-vif-unplugged:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:20:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-b2d3d6d3-bb11-4915-a6b2-e702306510ee req-69e69839-f7fa-4921-b476-e52a19feb8e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031349 Apr 18 09:20:27 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:29 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "name": "network-vif-deleted", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:29 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:29 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] Creating event network-vif-deleted:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:20:29 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-18cb509e-a916-432a-8e94-c48697d63964 req-1149d12f-3b26-4334-b21e-d6260fd03af2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028144 Apr 18 09:20:29 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:29 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836c1323-6d52-451a-9dc0-e02069653e09", "name": "network-vif-plugged", "status": "completed", "tag": "3f8d23ad-14fb-4698-b84b-caf372fd1f7f"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:20:29 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:29 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:29 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:29 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] Creating event network-vif-plugged:3f8d23ad-14fb-4698-b84b-caf372fd1f7f for instance 836c1323-6d52-451a-9dc0-e02069653e09 on user Apr 18 09:20:29 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-92bc4870-ef0b-4908-bd1f-07f9a7e6a5dc req-0d2fa4ea-b924-4358-bd5e-74d9f2debfcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029135 Apr 18 09:20:29 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=12 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] [instance: 98169e44-f735-4d2d-a739-21a3f35ac2d2] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:20:54 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] HTTP exception thrown: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Request method failure captured: Apr 18 09:20:54 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 HTTP/1.1 Apr 18 09:20:54 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:20:54 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:20:54 user devstack@n-api.service[61592]: Connection: close Apr 18 09:20:54 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:20:54 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:20:54 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:20:54 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:20:54 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmBTciqvcgExWCIwerzkTB0NCPOHC15UtFn4Vi4yDVHkrYvD1CAHuv-C4OFMpC51tv5LqLLpTbjvFMm99kGgafPwD2yKuz-d15NABuJpUthzFFLiL3mCONbNJIIxTmgBweMD0gMhxK1V4zidz40ikgCjU5dsrvbvlJXD4zLt0I-58bk Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Project-Id: bfa6a9dacd9f435792381cf297270399 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Project-Name: tempest-DeleteServersTestJSON-422232860 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfa6a9dacd9f435792381cf297270399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bfa6a9dacd9f435792381cf297270399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bfa6a9dacd9f435792381cf297270399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Tenant: tempest-DeleteServersTestJSON-422232860 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Tenant-Id: bfa6a9dacd9f435792381cf297270399 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-DeleteServersTestJSON-422232860 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-User: tempest-DeleteServersTestJSON-422232860-project-member Apr 18 09:20:54 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:20:54 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:20:54 user devstack@n-api.service[61592]: X-User-Id: 2451f5c9181b45589ba98960c826a978 Apr 18 09:20:54 user devstack@n-api.service[61592]: X-User-Name: tempest-DeleteServersTestJSON-422232860-project-member Apr 18 09:20:54 user devstack@n-api.service[61592]: method: > Apr 18 09:20:54 user devstack@n-api.service[61592]: exception: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. Apr 18 09:20:54 user devstack@n-api.service[61592]: action_args: {'id': '98169e44-f735-4d2d-a739-21a3f35ac2d2'} Apr 18 09:20:54 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. Apr 18 09:20:54 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:20:54 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] Returning 404 to user: Instance 98169e44-f735-4d2d-a739-21a3f35ac2d2 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:20:54 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-f1ba04f9-86cb-4cbb-b506-9804ef5656c6 tempest-DeleteServersTestJSON-422232860 tempest-DeleteServersTestJSON-422232860-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2" status: 404 len: 111 microversion: 2.1 time: 0.035595 Apr 18 09:20:54 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:20:54 2023] GET /compute/v2.1/servers/98169e44-f735-4d2d-a739-21a3f35ac2d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:21:05 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:05 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:05 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-ab8fbf52-b587-4e8b-8d53-df0c9fd50d6b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Action: 'create', calling method: .version_select at 0x7f0dce63de10>, body: {"keypair": {"name": "tempest-keypair-1840280116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXmPBiGwyPq0UYWERY5nt2ad4sPQzA3iuZDt8uTluPs3LllTbggreCT1/kHJ0DN4WhpWQw2M6PJBGsn7+/qd7IegnqCGT2HRu71Vi7IIF+T8PdpuBRM4DGw0TFx6qsohA=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:05 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-ab8fbf52-b587-4e8b-8d53-df0c9fd50d6b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for project d57115a4095849f5b815c2f62efb8b67. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:21:05 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-ab8fbf52-b587-4e8b-8d53-df0c9fd50d6b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for user ce75dcb962cb41bca277808fba4b407e and project d57115a4095849f5b815c2f62efb8b67. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:21:05 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-ab8fbf52-b587-4e8b-8d53-df0c9fd50d6b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170588 Apr 18 09:21:05 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 114/344] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:21:05 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=10 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-81595883", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "af633f27-0d5f-49bf-8a5f-41a4a317f575"}], "security_groups": [{"name": "tempest-securitygroup--887989822"}], "key_name": "tempest-keypair-1840280116", "user_data": "}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] validate_networks() for [('af633f27-0d5f-49bf-8a5f-41a4a317f575', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for project d57115a4095849f5b815c2f62efb8b67. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:21:07 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for user ce75dcb962cb41bca277808fba4b407e and project d57115a4095849f5b815c2f62efb8b67. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:21:08 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:21:08 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:21:08 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d33b6248-11fd-491e-a75e-946d7b2718e2 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.661583 Apr 18 09:21:08 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 116/345] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:21:07 2023] POST /compute/v2.1/servers => generated 399 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:21:08 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e52758cf-59ba-483f-9316-5fbb9561f838 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:08 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e52758cf-59ba-483f-9316-5fbb9561f838 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:08 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:08 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:08 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e52758cf-59ba-483f-9316-5fbb9561f838 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:08 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e52758cf-59ba-483f-9316-5fbb9561f838 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 200 len: 1230 microversion: 2.1 time: 0.064928 Apr 18 09:21:08 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:21:08 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 1230 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:21:10 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:10 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:10 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:10 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:10 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] Creating event network-changed:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:21:10 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-1f4d8a42-15c3-4d20-80bf-d66245c28ae2 req-3458c772-0f5b-451e-8544-82bd4e25be24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029978 Apr 18 09:21:10 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "name": "network-vif-plugged", "status": "completed", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] Creating event network-vif-plugged:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:21:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-44a01281-29c4-4d0a-9fef-a298ef1c784b req-a68bb447-46fe-403b-a586-795ad93fb80b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034217 Apr 18 09:21:12 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:14 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "name": "network-vif-plugged", "status": "completed", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:14 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] Creating event network-vif-plugged:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:21:14 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-d47c1f6e-b40f-4a8f-a2f4-52fc574073e1 req-2282a941-9cdf-4d5b-8a2d-fac54a96f76b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Apr 18 09:21:14 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:17 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:21:17 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 HTTP/1.1 Apr 18 09:21:17 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:21:17 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:21:17 user devstack@n-api.service[61593]: Connection: close Apr 18 09:21:17 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:21:17 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:21:17 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:21:17 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:21:17 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:21:17 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:21:17 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:21:17 user devstack@n-api.service[61593]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:21:17 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:21:17 user devstack@n-api.service[61593]: method: > Apr 18 09:21:17 user devstack@n-api.service[61593]: exception: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:21:17 user devstack@n-api.service[61593]: action_args: {'id': '836c1323-6d52-451a-9dc0-e02069653e09'} Apr 18 09:21:17 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:21:17 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:21:17 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:21:17 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-053ef994-34d2-4929-a131-2858b171741b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 404 len: 111 microversion: 2.20 time: 0.030340 Apr 18 09:21:17 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:21:17 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:21:17 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-47fec144-dbcf-4af9-84e1-5b6075fdfe84 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '.version_select at 0x7f0dce75bd90>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:17 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:17 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-47fec144-dbcf-4af9-84e1-5b6075fdfe84 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647550027" status: 204 len: 0 microversion: 2.20 time: 0.023514 Apr 18 09:21:17 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 09:21:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647550027 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:18 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:18 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-1a2e276d-0d67-4604-aae0-8127be5c1c21 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159219 Apr 18 09:21:18 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:21:18 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:18 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-7acfb8fb-64e0-40f6-9112-cc4276ff50f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Action: 'create', calling method: .version_select at 0x7f0dce63fe20>, body: {"keypair": {"name": "tempest-keypair-650043919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2CWPi1otz2UlbM/ygysamHO6ZAn2DTg3XZCeBa/iqyHmJoNpkGCUKgNl3iGmN+o7bg8szhOuqkzjSakJlSa5mFNCW41PO5DHVrnfTqIF7wdNY5NKcAmF81XFm0ZpUUbQ=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:18 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-7acfb8fb-64e0-40f6-9112-cc4276ff50f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for project cf7d15e50d7341a28f5c8925441f9692. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:21:18 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-7acfb8fb-64e0-40f6-9112-cc4276ff50f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for user 0cdd6ccedc1e455aa8815a441d298f44 and project cf7d15e50d7341a28f5c8925441f9692. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:21:18 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-7acfb8fb-64e0-40f6-9112-cc4276ff50f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.057316 Apr 18 09:21:18 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 117/353] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 09:21:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 18 09:21:19 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:19 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:19 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:19 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:19 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:19 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:19 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] Creating event network-changed:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:21:19 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-1ddfe960-664d-408f-a7ec-0464c1facb37 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe/ips" status: 200 len: 108 microversion: 2.1 time: 0.051955 Apr 18 09:21:19 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:21:19 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe/ips => generated 108 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:19 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-65c701db-ecad-4618-8e8f-a6341c69101d req-4bdce959-a26a-45ca-860f-baa1453e2eb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107411 Apr 18 09:21:19 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:20 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-182914690", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2f5119a0-e2e0-49d6-9884-3ebb5b952bfd"}], "security_groups": [{"name": "tempest-securitygroup--708323477"}], "key_name": "tempest-keypair-650043919", "user_data": "}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:20 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] validate_networks() for [('2f5119a0-e2e0-49d6-9884-3ebb5b952bfd', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:20 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:21:21 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e84d9470-c8bf-4001-a684-9167c499f99b tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 204 len: 0 microversion: 2.1 time: 0.115289 Apr 18 09:21:21 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:21:20 2023] DELETE /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcb9c492b52a4a58b7b34b87f541f44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4577b5b5e8d348018cf4ae386f17eae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:21 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-c4988843-be01-48cd-b244-e31b57b36bc9 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 200 len: 1671 microversion: 2.1 time: 0.230020 Apr 18 09:21:21 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:21:21 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:21:21 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "name": "network-vif-unplugged", "status": "completed", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:21 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:21 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] Creating event network-vif-unplugged:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:21:21 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-5d5c508d-d28d-4f98-8e8a-b3576a2258cc req-6f684cef-73d6-46f1-aca6-52557213eab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049860 Apr 18 09:21:21 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 121/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for project cf7d15e50d7341a28f5c8925441f9692. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Getting quotas for user 0cdd6ccedc1e455aa8815a441d298f44 and project cf7d15e50d7341a28f5c8925441f9692. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:21:21 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:21:21 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c7332826-7b16-4ad8-a920-879fbde5e92b tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.735571 Apr 18 09:21:21 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 118/359] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 09:21:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:21 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:21 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-daed72a0-929c-4851-b169-4a40e00c8196 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 200 len: 1274 microversion: 2.20 time: 0.088684 Apr 18 09:21:21 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 121/360] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:21:21 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:21:22 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "name": "network-vif-deleted", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:23 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] Creating event network-vif-deleted:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:21:23 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-3d384b9e-9567-4b0c-8ee3-21007ba6be5f req-0e6b9f1b-bfa4-4d0e-b733-3b88b8f32088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043757 Apr 18 09:21:23 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 122/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:23 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1470d558-4af0-4124-b837-a471c797cafe", "name": "network-vif-plugged", "status": "completed", "tag": "10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:23 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:23 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] Creating event network-vif-plugged:10307ddb-b9e6-4fe1-bff2-8f7ec6b23d5e for instance 1470d558-4af0-4124-b837-a471c797cafe on user Apr 18 09:21:23 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-40196b90-87eb-448f-b40c-fc416598cf67 req-682c3b24-a945-4297-9776-58bf3eca9258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Apr 18 09:21:23 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 119/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:25 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:25 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:25 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] Creating event network-changed:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:21:25 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-c7b21b25-cfd1-41ec-a4f9-3d9a0c9cb4ab req-9c72e39f-7d26-4050-96bd-e9d1954982bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028587 Apr 18 09:21:25 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:27 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "name": "network-vif-plugged", "status": "completed", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}, {"server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "name": "network-vif-plugged", "status": "completed", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:21:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:27 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Creating event network-vif-plugged:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:21:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] Creating event network-vif-plugged:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:21:27 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-0d4164cb-554e-422e-9f85-c2f1d2371f15 req-f2c267ac-5752-4649-98e4-1ccafbc8aff6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031263 Apr 18 09:21:27 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 123/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=10 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=5 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:21:58 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:21:58 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-212c898d-6dae-4f7c-9422-7096c47dd354 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 200 len: 1534 microversion: 2.1 time: 0.220133 Apr 18 09:21:58 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 120/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:21:58 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 1534 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=14 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:11 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:11 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe HTTP/1.1 Apr 18 09:22:11 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:22:11 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:22:11 user devstack@n-api.service[61594]: Connection: close Apr 18 09:22:11 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:22:11 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:22:11 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:22:11 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:22:11 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:11 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:11 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:22:11 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:22:11 user devstack@n-api.service[61594]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:11 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:11 user devstack@n-api.service[61594]: method: > Apr 18 09:22:11 user devstack@n-api.service[61594]: exception: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:11 user devstack@n-api.service[61594]: action_args: {'id': '1470d558-4af0-4124-b837-a471c797cafe'} Apr 18 09:22:11 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:11 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:11 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:11 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9e7c6a34-279b-431a-8881-958ec15c82d4 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 404 len: 111 microversion: 2.1 time: 0.041888 Apr 18 09:22:11 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:22:11 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-91877722-a7d1-404b-a99e-2071fdaf49af tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '.version_select at 0x7f0dce60aef0>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:11 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-91877722-a7d1-404b-a99e-2071fdaf49af tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027700054" status: 202 len: 0 microversion: 2.1 time: 0.032033 Apr 18 09:22:11 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 124/367] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:22:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027700054 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:22:11 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:22:11 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-726a46b9-ebbc-4b5c-970c-edb7801a85f4 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 200 len: 1585 microversion: 2.20 time: 0.211722 Apr 18 09:22:11 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 121/368] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:22:11 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 1585 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61594]: request: DELETE /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61594]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61594]: method: > Apr 18 09:22:12 user devstack@n-api.service[61594]: exception: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: action_args: {'id': '1470d558-4af0-4124-b837-a471c797cafe'} Apr 18 09:22:12 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d19242f8-46bf-4d92-b5b0-32bcfa4967d5 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 404 len: 111 microversion: 2.1 time: 0.036684 Apr 18 09:22:12 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:22:12 2023] DELETE /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 1470d558-4af0-4124-b837-a471c797cafe] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61592]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61592]: method: > Apr 18 09:22:12 user devstack@n-api.service[61592]: exception: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: action_args: {'id': '1470d558-4af0-4124-b837-a471c797cafe'} Apr 18 09:22:12 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 1470d558-4af0-4124-b837-a471c797cafe could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-ea8ff57f-2e7c-4266-ac8f-bb97bfa45f41 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe" status: 404 len: 111 microversion: 2.1 time: 0.030771 Apr 18 09:22:12 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 125/370] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:22:12 2023] GET /compute/v2.1/servers/1470d558-4af0-4124-b837-a471c797cafe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61593]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61593]: method: > Apr 18 09:22:12 user devstack@n-api.service[61593]: exception: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: action_args: {'id': '20791ca9-4ac4-4d58-9288-e0b9362b131c'} Apr 18 09:22:12 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9b92e842-8acf-4767-8f38-bdb254dc2ea8 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 404 len: 111 microversion: 2.1 time: 0.027767 Apr 18 09:22:12 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 122/371] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:22:12 2023] DELETE /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: 20791ca9-4ac4-4d58-9288-e0b9362b131c] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61594]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61594]: method: > Apr 18 09:22:12 user devstack@n-api.service[61594]: exception: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: action_args: {'id': '20791ca9-4ac4-4d58-9288-e0b9362b131c'} Apr 18 09:22:12 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. Apr 18 09:22:12 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance 20791ca9-4ac4-4d58-9288-e0b9362b131c could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-a8e6d880-e796-47f7-a14f-e9e824036e06 tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c" status: 404 len: 111 microversion: 2.1 time: 0.029886 Apr 18 09:22:12 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:22:12 2023] GET /compute/v2.1/servers/20791ca9-4ac4-4d58-9288-e0b9362b131c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61592]: request: DELETE /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61592]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61592]: method: > Apr 18 09:22:12 user devstack@n-api.service[61592]: exception: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: action_args: {'id': 'c3b635b6-2954-46b1-a6a7-a1f7fe067fc9'} Apr 18 09:22:12 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-a8406716-c9ac-45c1-af0d-0c9e65cb1bde tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 404 len: 111 microversion: 2.1 time: 0.034639 Apr 18 09:22:12 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:22:12 2023] DELETE /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] [instance: c3b635b6-2954-46b1-a6a7-a1f7fe067fc9] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] HTTP exception thrown: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Request method failure captured: Apr 18 09:22:12 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 HTTP/1.1 Apr 18 09:22:12 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:22:12 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:22:12 user devstack@n-api.service[61593]: Connection: close Apr 18 09:22:12 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:22:12 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:22:12 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:22:12 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:22:12 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPl9PBF8lNINfSWHXSmGv72vu5QcjE3RHffSn1MsieMaaYitam_qxegSOK9WoaHEfUrSqAmKnsL6ulM_wYWhvFKgA1uyOe3E1xNojv51AUueeTOPwEYjbyZ6aBKsP-56hVfD2xRajn7trDpWOasYXZpPvITDnIWi6v-Cm1GhEh4dbppo Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4577b5b5e8d348018cf4ae386f17eae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant-Id: 4577b5b5e8d348018cf4ae386f17eae8 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286861146 Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Id: bcb9c492b52a4a58b7b34b87f541f44e Apr 18 09:22:12 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeNegativeTest-286861146-project-member Apr 18 09:22:12 user devstack@n-api.service[61593]: method: > Apr 18 09:22:12 user devstack@n-api.service[61593]: exception: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: action_args: {'id': 'c3b635b6-2954-46b1-a6a7-a1f7fe067fc9'} Apr 18 09:22:12 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. Apr 18 09:22:12 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:22:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] Returning 404 to user: Instance c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:22:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-ebaf0769-e3b0-4e6b-a57c-5771c917b7fa tempest-AttachVolumeNegativeTest-286861146 tempest-AttachVolumeNegativeTest-286861146-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9" status: 404 len: 111 microversion: 2.1 time: 0.027664 Apr 18 09:22:12 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 123/374] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:22:12 2023] GET /compute/v2.1/servers/c3b635b6-2954-46b1-a6a7-a1f7fe067fc9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:58 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-9ef58477-421b-4238-9d78-e2b62418bc4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.194808 Apr 18 09:22:58 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:22:58 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:22:59 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:22:59 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] Creating event network-changed:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:22:59 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-0f11c562-77df-4136-829e-20fe995e79aa req-e47e7c98-e6b1-4c4b-ab6f-6d63fecc96ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035720 Apr 18 09:22:59 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 127/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=10 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:00 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-21fc0733-f8a2-4883-a135-5042bb40fb4c tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f/ips" status: 200 len: 142 microversion: 2.1 time: 0.044769 Apr 18 09:23:00 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 124/377] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:23:00 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f/ips => generated 142 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:01 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:02 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:23:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-f15eac32-b596-426e-ba59-7be656cedb61 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 204 len: 0 microversion: 2.1 time: 0.115450 Apr 18 09:23:02 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 127/378] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:23:01 2023] DELETE /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:02 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:23:02 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e3b07da8-cc1e-453a-beee-964db696985b tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 200 len: 1658 microversion: 2.1 time: 0.164737 Apr 18 09:23:02 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 128/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:23:02 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 1658 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:23:02 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "name": "network-vif-unplugged", "status": "completed", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:02 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:02 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] Creating event network-vif-unplugged:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:23:02 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-ab803c81-b1a9-48ae-814d-0d8b9d6b4b3e req-a5ed81e8-1690-4ea2-89d5-c1c44937e0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043838 Apr 18 09:23:02 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 125/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:23:04 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "name": "network-vif-plugged", "status": "completed", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}, {"server_uuid": "ac69b41b-da11-4572-8bf1-5b0fbbaead8f", "name": "network-vif-deleted", "tag": "028495a1-1a6f-4f61-9ec5-93ee300c1e22"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:04 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Creating event network-vif-plugged:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:23:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] Creating event network-vif-deleted:028495a1-1a6f-4f61-9ec5-93ee300c1e22 for instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f on user Apr 18 09:23:04 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-bc1b08e9-904a-4f0d-8cbb-45ec7f259940 req-ec107d06-f07f-4e05-a09d-21972b43fd33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046238 Apr 18 09:23:04 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:11 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:12 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-c8876475-a767-4759-a4c6-3ad518da5ddf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.163939 Apr 18 09:23:12 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 129/382] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 09:23:11 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:12 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:12 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] Creating event network-changed:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:23:13 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-85c53f39-2568-49e4-a74b-88c448de1cef req-5f4641d0-62d2-4b48-8199-f6624173a6fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037876 Apr 18 09:23:13 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 126/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:13 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:13 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-b7c7dd5c-55fb-420d-a4c5-9d2a76cff5bf tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613/ips" status: 200 len: 110 microversion: 2.20 time: 0.039502 Apr 18 09:23:13 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 129/384] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 09:23:13 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:14 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:23:14 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-2a1838c4-72c6-40ae-b001-aad377819418 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 204 len: 0 microversion: 2.20 time: 0.131150 Apr 18 09:23:14 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 130/385] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:23:14 2023] DELETE /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:23:14 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cdd6ccedc1e455aa8815a441d298f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf7d15e50d7341a28f5c8925441f9692', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:23:14 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-62f355d4-e1ae-44af-aaa7-bd5fff2a9b46 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 200 len: 1710 microversion: 2.20 time: 0.181782 Apr 18 09:23:14 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 127/386] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:23:14 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 09:23:14 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "name": "network-vif-unplugged", "status": "completed", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:14 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] Creating event network-vif-unplugged:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:23:14 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-39fe2f91-20b2-4b6d-b407-73357db3a96e req-5ef15e56-2426-470d-a5d8-7a8f4b40313c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040017 Apr 18 09:23:14 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:16 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "name": "network-vif-plugged", "status": "completed", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}, {"server_uuid": "6c3a9f89-1ea2-4ddb-a999-628dfd781613", "name": "network-vif-deleted", "tag": "a33eb87d-615b-472f-837a-1d119a8e9bc3"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:16 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Creating event network-vif-plugged:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:23:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] Creating event network-vif-deleted:a33eb87d-615b-472f-837a-1d119a8e9bc3 for instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 on user Apr 18 09:23:16 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-7661c9a7-06b3-4e27-9db5-783e9ecc106c req-f6e73025-605a-4325-ad1c-cfb17537350b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029839 Apr 18 09:23:16 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 131/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:23:52 user devstack@n-api.service[61593]: request: GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f HTTP/1.1 Apr 18 09:23:52 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:23:52 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:23:52 user devstack@n-api.service[61593]: Connection: close Apr 18 09:23:52 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:23:52 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:23:52 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:23:52 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:23:52 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:23:52 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:23:52 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:23:52 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:23:52 user devstack@n-api.service[61593]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:23:52 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:23:52 user devstack@n-api.service[61593]: method: > Apr 18 09:23:52 user devstack@n-api.service[61593]: exception: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:23:52 user devstack@n-api.service[61593]: action_args: {'id': 'ac69b41b-da11-4572-8bf1-5b0fbbaead8f'} Apr 18 09:23:52 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:23:52 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:23:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:23:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-06d82c7c-ec2a-44d9-92ac-22284bd21cd7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 404 len: 111 microversion: 2.1 time: 0.042483 Apr 18 09:23:52 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 128/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:23:52 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:23:52 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:52 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:52 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-879d3e85-cc1c-427c-8318-7d81661c4b52 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '.version_select at 0x7f0dce75add0>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-879d3e85-cc1c-427c-8318-7d81661c4b52 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840280116" status: 202 len: 0 microversion: 2.1 time: 0.029689 Apr 18 09:23:52 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 09:23:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840280116 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:23:53 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:53 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:23:53 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-3332c7cc-596c-441a-8c8a-dc73ef290cd8 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Action: 'create', calling method: .version_select at 0x7f0dce60aa70>, body: {"keypair": {"name": "tempest-keypair-862239498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnPuvmQ8dZv7KlSF0JsPNKJP2WB5veGcyVere/O592F3HTH783YR2izqSUAC+jmega/Z/xmToR96HiahiMQVkKHb76m8lGVayXxjRI0tYzj/2DMtTH0faXjbtui238cgg=="}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:53 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-3332c7cc-596c-441a-8c8a-dc73ef290cd8 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for project d57115a4095849f5b815c2f62efb8b67. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:23:53 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-3332c7cc-596c-441a-8c8a-dc73ef290cd8 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for user ce75dcb962cb41bca277808fba4b407e and project d57115a4095849f5b815c2f62efb8b67. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:23:53 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-3332c7cc-596c-441a-8c8a-dc73ef290cd8 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051945 Apr 18 09:23:53 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 132/391] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:23:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1513604368", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "af633f27-0d5f-49bf-8a5f-41a4a317f575"}], "security_groups": [{"name": "tempest-securitygroup--175678387"}], "key_name": "tempest-keypair-862239498", "user_data": "}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] validate_networks() for [('af633f27-0d5f-49bf-8a5f-41a4a317f575', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for project d57115a4095849f5b815c2f62efb8b67. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Getting quotas for user ce75dcb962cb41bca277808fba4b407e and project d57115a4095849f5b815c2f62efb8b67. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:23:55 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:23:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-9d83ebd2-b4fd-4a1f-8c61-5fe7e87c3980 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.838941 Apr 18 09:23:56 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 129/392] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:23:55 2023] POST /compute/v2.1/servers => generated 399 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:23:56 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-65c7c952-7cee-4bd3-9fdb-c5959338067d tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:23:56 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-65c7c952-7cee-4bd3-9fdb-c5959338067d tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:23:56 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-65c7c952-7cee-4bd3-9fdb-c5959338067d tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:23:56 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-65c7c952-7cee-4bd3-9fdb-c5959338067d tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 200 len: 1231 microversion: 2.1 time: 0.060192 Apr 18 09:23:56 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 132/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:23:56 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 1231 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:23:58 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:23:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:23:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:23:58 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:23:58 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] Creating event network-changed:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:23:58 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-0a778b5e-962a-46e9-8061-a093a2260e83 req-d42e7691-fa2e-457d-831e-9b68b2e18f9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 Apr 18 09:23:58 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 133/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:24:00 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:00 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:00 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:24:00 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-b56f4a6d-b9ac-430b-ba55-6551b19df7df req-8275bbbe-d763-4e9b-9ac1-4a97c9d998d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Apr 18 09:24:00 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 130/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:24:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:24:02 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:02 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:24:02 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-5e64c3a5-6fd0-4f9c-91ec-cfda0c9348b7 req-3f236170-6376-4520-9b20-55eb3201f68e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029425 Apr 18 09:24:02 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:04 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:24:04 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 HTTP/1.1 Apr 18 09:24:04 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:24:04 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:24:04 user devstack@n-api.service[61592]: Connection: close Apr 18 09:24:04 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:24:04 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:24:04 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:24:04 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:24:04 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:04 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:24:04 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:24:04 user devstack@n-api.service[61592]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:24:04 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:04 user devstack@n-api.service[61592]: method: > Apr 18 09:24:04 user devstack@n-api.service[61592]: exception: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:04 user devstack@n-api.service[61592]: action_args: {'id': '6c3a9f89-1ea2-4ddb-a999-628dfd781613'} Apr 18 09:24:04 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:04 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:04 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:24:04 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-bece30a6-a0be-432d-8684-a3988ead3225 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 404 len: 111 microversion: 2.20 time: 0.243824 Apr 18 09:24:04 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 134/397] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:24:04 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 111 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:24:04 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-a804a4c7-eb97-4299-9031-9ea84db651fa tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '.version_select at 0x7f0dcf2f7520>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:05 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-a804a4c7-eb97-4299-9031-9ea84db651fa tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650043919" status: 204 len: 0 microversion: 2.20 time: 0.025650 Apr 18 09:24:05 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 131/398] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 09:24:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650043919 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:05 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:24:05 user devstack@n-api.service[61594]: request: DELETE /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 HTTP/1.1 Apr 18 09:24:05 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:24:05 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:24:05 user devstack@n-api.service[61594]: Connection: close Apr 18 09:24:05 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:24:05 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:24:05 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:24:05 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:24:05 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:05 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:24:05 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:24:05 user devstack@n-api.service[61594]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:24:05 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:05 user devstack@n-api.service[61594]: method: > Apr 18 09:24:05 user devstack@n-api.service[61594]: exception: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:05 user devstack@n-api.service[61594]: action_args: {'id': '6c3a9f89-1ea2-4ddb-a999-628dfd781613'} Apr 18 09:24:05 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:05 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:05 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:24:05 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-22a7958e-effe-42e6-8b06-016ba82b66ea tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 404 len: 111 microversion: 2.20 time: 0.029352 Apr 18 09:24:05 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 134/399] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:24:05 2023] DELETE /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 6c3a9f89-1ea2-4ddb-a999-628dfd781613] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:05 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:24:06 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 HTTP/1.1 Apr 18 09:24:06 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:24:06 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:24:06 user devstack@n-api.service[61592]: Connection: close Apr 18 09:24:06 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:24:06 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:24:06 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:24:06 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:24:06 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61592]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:24:06 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61592]: method: > Apr 18 09:24:06 user devstack@n-api.service[61592]: exception: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61592]: action_args: {'id': '6c3a9f89-1ea2-4ddb-a999-628dfd781613'} Apr 18 09:24:06 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 6c3a9f89-1ea2-4ddb-a999-628dfd781613 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:24:06 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-22d42725-9df5-4f3b-8131-44adeed503a5 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613" status: 404 len: 111 microversion: 2.20 time: 0.027865 Apr 18 09:24:06 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 135/400] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:24:05 2023] GET /compute/v2.1/servers/6c3a9f89-1ea2-4ddb-a999-628dfd781613 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:24:06 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 HTTP/1.1 Apr 18 09:24:06 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:24:06 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:24:06 user devstack@n-api.service[61593]: Connection: close Apr 18 09:24:06 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:24:06 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:24:06 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:24:06 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:24:06 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61593]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:24:06 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61593]: method: > Apr 18 09:24:06 user devstack@n-api.service[61593]: exception: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61593]: action_args: {'id': '836c1323-6d52-451a-9dc0-e02069653e09'} Apr 18 09:24:06 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:24:06 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-2488914c-7be8-45cf-9366-a82aa09d72b6 tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 404 len: 111 microversion: 2.20 time: 0.039340 Apr 18 09:24:06 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 132/401] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 09:24:06 2023] DELETE /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] [instance: 836c1323-6d52-451a-9dc0-e02069653e09] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] HTTP exception thrown: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Request method failure captured: Apr 18 09:24:06 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 HTTP/1.1 Apr 18 09:24:06 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:24:06 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:24:06 user devstack@n-api.service[61594]: Connection: close Apr 18 09:24:06 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:24:06 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:24:06 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:24:06 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:24:06 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPmBnvtvD4Gl-OABKPRunc0YjBIvkODSQWs3E2wqB-0alt8OWsRglGFF_rA3kEAlubM1a-cFF2QME6dnn6gRyPcgQpnmm2_wPe1A8HqEQD0X5yhxGrvSnFnXaL7V7LktRf89ZvD0stSIzltsUUzB5b76QhhP9iZbIhz9RNeAR5chTkLk Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Project-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf7d15e50d7341a28f5c8925441f9692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Tenant-Id: cf7d15e50d7341a28f5c8925441f9692 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472338190 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:24:06 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:24:06 user devstack@n-api.service[61594]: X-User-Id: 0cdd6ccedc1e455aa8815a441d298f44 Apr 18 09:24:06 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472338190-project-member Apr 18 09:24:06 user devstack@n-api.service[61594]: method: > Apr 18 09:24:06 user devstack@n-api.service[61594]: exception: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61594]: action_args: {'id': '836c1323-6d52-451a-9dc0-e02069653e09'} Apr 18 09:24:06 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. Apr 18 09:24:06 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:24:06 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] Returning 404 to user: Instance 836c1323-6d52-451a-9dc0-e02069653e09 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:24:06 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-98486296-f2fd-4c31-ae2a-1c659f7ecd7e tempest-AttachVolumeShelveTestJSON-1472338190 tempest-AttachVolumeShelveTestJSON-1472338190-project-member] 10.0.0.210 "GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09" status: 404 len: 111 microversion: 2.20 time: 0.029297 Apr 18 09:24:06 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 135/402] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 09:24:06 2023] GET /compute/v2.1/servers/836c1323-6d52-451a-9dc0-e02069653e09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:46 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:24:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-e300803c-b178-45f4-9da2-832ff121f3c3 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 200 len: 1535 microversion: 2.1 time: 0.831527 Apr 18 09:24:46 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 136/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:24:46 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 1535 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:24:52 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c5c78bc0-acef-474f-96c5-cd41087395f2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Action: 'create', calling method: .version_select at 0x7f0dce63dfc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-789238646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeZBr0+A9cxoKPiuzfH5oapnc6wH9aSwRGA4rXMRfdGqVMWjJxnHSJAL9JJLpdahwDLIeikAUe/Qet04/e69lN7jK1X/g8HMCmGVBL37s7R7idhlNlQsmWMtV0NNJCFaQ=="}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:52 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:52 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:52 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-c5c78bc0-acef-474f-96c5-cd41087395f2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:24:52 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-c5c78bc0-acef-474f-96c5-cd41087395f2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for user 23183785a98e4e77aaf6c77e29d158b7 and project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'key_pairs'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:24:52 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c5c78bc0-acef-474f-96c5-cd41087395f2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057478 Apr 18 09:24:52 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 133/404] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:24:52 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-910463063", "imageRef": "97756750-e8d7-4471-8192-ecabdbc97bc7", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-789238646", "networks": [{"uuid": "c280e39a-43ab-49b9-b7a1-27276c7abd1c"}]}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] validate_networks() for [('c280e39a-43ab-49b9-b7a1-27276c7abd1c', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for user 23183785a98e4e77aaf6c77e29d158b7 and project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:24:53 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='97756750-e8d7-4471-8192-ecabdbc97bc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:24:53 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-b0c2a6ef-ba4e-4e54-b8e8-746bc0a03799 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.625786 Apr 18 09:24:53 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 136/405] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:24:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:24:53 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-6eedc003-172e-439a-8c51-8ec7da909abe tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:24:53 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-6eedc003-172e-439a-8c51-8ec7da909abe tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:24:53 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-6eedc003-172e-439a-8c51-8ec7da909abe tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:24:53 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-6eedc003-172e-439a-8c51-8ec7da909abe tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 200 len: 1251 microversion: 2.1 time: 0.063699 Apr 18 09:24:53 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:24:53 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 1251 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:24:56 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:56 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] Creating event network-changed:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:24:56 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-633832bd-10aa-44b4-9722-dcc7d8f046db req-d721607c-0e36-4dd2-9fdd-142b7a50eb55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081638 Apr 18 09:24:56 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 134/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:24:58 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "name": "network-vif-plugged", "status": "completed", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:24:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:24:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:24:58 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:24:58 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] Creating event network-vif-plugged:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:24:58 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-4c715f61-8c1a-4c61-ab9a-9bf14f3fff20 req-f95267a7-3db1-457d-9bae-1b9b19c02480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Apr 18 09:24:58 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:24:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:00 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "name": "network-vif-plugged", "status": "completed", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:25:00 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:00 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:00 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:00 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:00 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] Creating event network-vif-plugged:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:25:00 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-9e25807c-437e-46e1-a7bd-0bfced20a2c6 req-ddc7e1d3-d496-40b0-9bb8-43fa23fde923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Apr 18 09:25:00 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 138/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:44 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:25:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-5f352ba5-3ae0-4cb2-9090-b5124d47a3c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 200 len: 1536 microversion: 2.1 time: 0.574858 Apr 18 09:25:44 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 135/410] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:25:43 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 1536 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=4 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d5e2a920-105a-421d-81d8-302f9f6f7fd4 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.167023 Apr 18 09:25:47 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 138/411] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 09:25:47 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050/os-interface => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=8 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] Creating event network-changed:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-ce1e7e79-0986-4360-b9b1-efb206791bf3 req-82a9958b-aaad-4d0e-a56b-52fb08ab499f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036339 Apr 18 09:25:47 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:25:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:47 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:48 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-5f22706b-b194-4c2d-acb9-3a5d950f6786 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050/ips" status: 200 len: 103 microversion: 2.1 time: 0.036022 Apr 18 09:25:48 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 136/413] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 09:25:47 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050/ips => generated 103 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:49 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:25:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-73dec856-d28b-4c98-9bb6-1ca72e319409 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 204 len: 0 microversion: 2.1 time: 0.107381 Apr 18 09:25:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:25:49 2023] DELETE /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:49 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce75dcb962cb41bca277808fba4b407e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57115a4095849f5b815c2f62efb8b67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:25:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-3035b052-1b09-4ea1-82d6-a090bbe8c808 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 200 len: 1660 microversion: 2.1 time: 0.160784 Apr 18 09:25:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 140/415] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:25:49 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 1660 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:25:49 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-unplugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}, {"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:25:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Creating event network-vif-unplugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:50 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-77e9aa7f-24f5-4c94-acc2-ddf7a5a140ea req-58c98ed3-8c57-417b-ab6e-92b2102b3104 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035536 Apr 18 09:25:50 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 137/416] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:25:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:25:52 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}, {"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}, {"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-unplugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}, {"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-plugged", "status": "completed", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}, {"server_uuid": "d01c2987-ca1c-4603-a56b-309fa5a5c050", "name": "network-vif-deleted", "tag": "79e39199-87ce-43ff-b212-43b1a4dc7d99"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:25:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:25:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:25:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Creating event network-vif-unplugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Creating event network-vif-plugged:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] Creating event network-vif-deleted:79e39199-87ce-43ff-b212-43b1a4dc7d99 for instance d01c2987-ca1c-4603-a56b-309fa5a5c050 on user Apr 18 09:25:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-1ca127c3-4b46-4fc4-be85-5259e9d84a1c req-ff27b23f-84f5-42d9-bdb3-e40d59f43aba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040355 Apr 18 09:25:52 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 140/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=4 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=8 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:26:39 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 HTTP/1.1 Apr 18 09:26:39 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:26:39 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:26:39 user devstack@n-api.service[61592]: Connection: close Apr 18 09:26:39 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:26:39 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:26:39 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:26:39 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:26:39 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:39 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:39 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:26:39 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:26:39 user devstack@n-api.service[61592]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:26:39 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:39 user devstack@n-api.service[61592]: method: > Apr 18 09:26:39 user devstack@n-api.service[61592]: exception: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:39 user devstack@n-api.service[61592]: action_args: {'id': 'd01c2987-ca1c-4603-a56b-309fa5a5c050'} Apr 18 09:26:39 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:39 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:26:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-2a48dc25-f235-4fa3-b99d-8ae6f2fabec7 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 404 len: 111 microversion: 2.1 time: 0.140107 Apr 18 09:26:39 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 141/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:39 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:26:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:39 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=12 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-b20b2607-8696-4efe-9a89-0556c857ac20 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '.version_select at 0x7f0dce63feb0>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:39 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-b20b2607-8696-4efe-9a89-0556c857ac20 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862239498" status: 202 len: 0 microversion: 2.1 time: 0.027962 Apr 18 09:26:39 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 138/419] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 09:26:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862239498 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:26:40 user devstack@n-api.service[61594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 09:26:40 user devstack@n-api.service[61594]: Tue Apr 18 09:26:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 (ip 10.0.0.210) !!! Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:26:40 user devstack@n-api.service[61594]: request: DELETE /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 HTTP/1.1 Apr 18 09:26:40 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:26:40 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:26:40 user devstack@n-api.service[61594]: Connection: close Apr 18 09:26:40 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:26:40 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:26:40 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:26:40 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:26:40 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61594]: method: > Apr 18 09:26:40 user devstack@n-api.service[61594]: exception: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: action_args: {'id': 'd01c2987-ca1c-4603-a56b-309fa5a5c050'} Apr 18 09:26:40 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:26:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-72704ac2-c7e8-493a-becf-7d5c4e7de736 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 404 len: 111 microversion: 2.1 time: 0.046809 Apr 18 09:26:40 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 141/420] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:26:40 2023] DELETE /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: d01c2987-ca1c-4603-a56b-309fa5a5c050] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:26:40 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 HTTP/1.1 Apr 18 09:26:40 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:26:40 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:26:40 user devstack@n-api.service[61592]: Connection: close Apr 18 09:26:40 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:26:40 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:26:40 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:26:40 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:26:40 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61592]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61592]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:26:40 user devstack@n-api.service[61592]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61592]: method: > Apr 18 09:26:40 user devstack@n-api.service[61592]: exception: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61592]: action_args: {'id': 'd01c2987-ca1c-4603-a56b-309fa5a5c050'} Apr 18 09:26:40 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. Apr 18 09:26:40 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance d01c2987-ca1c-4603-a56b-309fa5a5c050 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:26:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-936c3be3-45db-4369-9188-bc7b3bdbfcb9 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050" status: 404 len: 111 microversion: 2.1 time: 0.031539 Apr 18 09:26:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:40 2023] GET /compute/v2.1/servers/d01c2987-ca1c-4603-a56b-309fa5a5c050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.wsgi [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:26:40 user devstack@n-api.service[61593]: request: DELETE /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f HTTP/1.1 Apr 18 09:26:40 user devstack@n-api.service[61593]: Accept: application/json Apr 18 09:26:40 user devstack@n-api.service[61593]: Accept-Encoding: identity Apr 18 09:26:40 user devstack@n-api.service[61593]: Connection: close Apr 18 09:26:40 user devstack@n-api.service[61593]: Content-Length: 0 Apr 18 09:26:40 user devstack@n-api.service[61593]: Content-Type: application/json Apr 18 09:26:40 user devstack@n-api.service[61593]: Host: 10.0.0.210 Apr 18 09:26:40 user devstack@n-api.service[61593]: Openstack-System-Scope: None Apr 18 09:26:40 user devstack@n-api.service[61593]: User-Agent: python-urllib3/1.26.15 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Domain-Id: None Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Domain-Name: None Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Identity-Status: Confirmed Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Is-Admin-Project: True Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Project-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Project-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Role: member,reader Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Roles: member,reader Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61593]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61593]: X-User-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61593]: X-User-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61593]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:26:40 user devstack@n-api.service[61593]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61593]: method: > Apr 18 09:26:40 user devstack@n-api.service[61593]: exception: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61593]: action_args: {'id': 'ac69b41b-da11-4572-8bf1-5b0fbbaead8f'} Apr 18 09:26:40 user devstack@n-api.service[61593]: {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61593]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. {{(pid=61593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:26:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-f3cb8173-e61d-4bb6-b0f1-6649e69f0366 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 404 len: 111 microversion: 2.1 time: 0.028324 Apr 18 09:26:40 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:26:40 2023] DELETE /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] [instance: ac69b41b-da11-4572-8bf1-5b0fbbaead8f] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] HTTP exception thrown: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Request method failure captured: Apr 18 09:26:40 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f HTTP/1.1 Apr 18 09:26:40 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:26:40 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:26:40 user devstack@n-api.service[61594]: Connection: close Apr 18 09:26:40 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:26:40 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:26:40 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:26:40 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:26:40 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPmEBjJVlYPrSX4GCAxJPqRJYOcrWuvKbe3bgz-MZ1rExD7cuQ_-8QQrS_rj251WXLKUuC03cRyscWTM7Neb7HJbP69YdJPtaQ5SxFnw8YXuV8Z7psVi7Rtf7h7EcPeY2zMhpYMYeh5BZHaTFXHp6id-82vOXX-M5Sx2dfczaaFk212Y Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Project-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d57115a4095849f5b815c2f62efb8b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant-Id: d57115a4095849f5b815c2f62efb8b67 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540094481 Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Id: ce75dcb962cb41bca277808fba4b407e Apr 18 09:26:40 user devstack@n-api.service[61594]: X-User-Name: tempest-AttachVolumeTestJSON-540094481-project-member Apr 18 09:26:40 user devstack@n-api.service[61594]: method: > Apr 18 09:26:40 user devstack@n-api.service[61594]: exception: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: action_args: {'id': 'ac69b41b-da11-4572-8bf1-5b0fbbaead8f'} Apr 18 09:26:40 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. Apr 18 09:26:40 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:26:40 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] Returning 404 to user: Instance ac69b41b-da11-4572-8bf1-5b0fbbaead8f could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:26:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-d88cfab1-c0ff-4dc1-af0c-85c7dba2ef91 tempest-AttachVolumeTestJSON-540094481 tempest-AttachVolumeTestJSON-540094481-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f" status: 404 len: 111 microversion: 2.1 time: 0.027770 Apr 18 09:26:40 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 142/423] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:40 2023] GET /compute/v2.1/servers/ac69b41b-da11-4572-8bf1-5b0fbbaead8f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:26:44 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-0dd3cabb-72f2-411e-9c67-fd09550466b1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 200 len: 1536 microversion: 2.1 time: 0.217691 Apr 18 09:26:44 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 143/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:44 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 1536 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Searching by: {'deleted': False, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d'} {{(pid=61593) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61593]: DEBUG nova.compute.multi_cell_list [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 09:26:44 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-26a701be-8fbe-4f3e-a526-6a9bbf70c5b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.200844 Apr 18 09:26:44 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 09:26:44 2023] GET /compute/v2.1/servers => generated 340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:44 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:26:45 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ebea5720-517a-4452-885c-29fc29624d8a tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 200 len: 1536 microversion: 2.1 time: 0.142182 Apr 18 09:26:45 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 143/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:44 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 1536 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:46 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Going to try to terminate instance {{(pid=61592) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:26:46 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-fc3e18b9-8539-4ce0-a4bd-f8380f2ecd9c tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 204 len: 0 microversion: 2.1 time: 0.113875 Apr 18 09:26:46 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:26:46 2023] DELETE /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:46 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:26:46 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-0b16260b-b836-44d0-a3ae-db14e5b3fee2 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 200 len: 1542 microversion: 2.1 time: 0.232091 Apr 18 09:26:46 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 141/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:46 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 1542 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:26:47 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "name": "network-vif-unplugged", "status": "completed", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:47 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] Creating event network-vif-unplugged:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:26:47 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-c58947ce-4950-4bb6-9955-794593a5be79 req-19f01b65-1420-4bac-ba3a-5b98c7da10f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144872 Apr 18 09:26:47 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 144/429] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 09:26:48 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "name": "network-vif-deleted", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:48 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:48 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] Creating event network-vif-deleted:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:26:48 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-315ac1fe-4c3e-4ab4-bd3b-1394437369e8 req-e9af95b9-1243-4d5e-adf0-d822b936c446 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030578 Apr 18 09:26:48 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 145/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:48 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1071303051", "imageRef": "ff4064a4-6d61-4d49-8062-742a8683d7b9", "flavorRef": "42", "networks": [{"uuid": "20a8f1eb-26b0-49a2-8908-d260a3f251f1"}]}} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.network.neutron [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] validate_networks() for [('20a8f1eb-26b0-49a2-8908-d260a3f251f1', None, None, None, None, None)] {{(pid=61593) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:26:49 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748ca482-c079-4ae8-8631-161a28648aa4", "name": "network-vif-plugged", "status": "completed", "tag": "25b39951-2de8-4fbf-9901-dfb1428af9ca"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:49 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] Creating event network-vif-plugged:25b39951-2de8-4fbf-9901-dfb1428af9ca for instance 748ca482-c079-4ae8-8631-161a28648aa4 on user Apr 18 09:26:49 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-a7cf8c00-9ef0-47df-bb7b-7a0b648decf7 req-e58c0e3e-99bf-450c-8efd-928d3cf080fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027010 Apr 18 09:26:49 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Flavor limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Image limits 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Flavor pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Image pref 0:0:0 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.virt.hardware [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Getting quotas for project 0cad586fd06f4754b7bba571684cab0b. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.quota [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Getting quotas for user e92d52f1092d423bb8b7b4d6fb65a740 and project 0cad586fd06f4754b7bba571684cab0b. Resources: {'ram', 'instances', 'cores'} {{(pid=61593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Going to run 1 instances... {{(pid=61593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:26:49 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ff4064a4-6d61-4d49-8062-742a8683d7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:26:49 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-92d019ba-f4b5-4883-a8bb-106ad3767bdc tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.711618 Apr 18 09:26:49 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 142/432] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:26:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:26:49 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-5ea4dc11-0e44-4368-9f59-6099550740db tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:26:49 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5ea4dc11-0e44-4368-9f59-6099550740db tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:26:49 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-5ea4dc11-0e44-4368-9f59-6099550740db tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d52f1092d423bb8b7b4d6fb65a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad586fd06f4754b7bba571684cab0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:26:49 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-5ea4dc11-0e44-4368-9f59-6099550740db tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20" status: 200 len: 1208 microversion: 2.1 time: 0.059152 Apr 18 09:26:49 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 146/433] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:26:49 2023] GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 => generated 1208 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:26:52 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:52 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] Creating event network-changed:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:26:52 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-f86ebe51-79ac-4c04-9c38-723ee096322d req-c2bda51a-381b-4bef-b48b-7011bb9bb462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029083 Apr 18 09:26:52 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 146/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:54 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "name": "network-vif-plugged", "status": "completed", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:54 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] Creating event network-vif-plugged:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:26:54 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-35e84c2c-d0ba-4be1-8f4e-0a57456ccb02 req-07066a7a-2473-42f5-accb-a089a893e3b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Apr 18 09:26:54 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 143/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:26:56 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "name": "network-vif-plugged", "status": "completed", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:26:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:26:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:26:56 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:26:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] Creating event network-vif-plugged:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:26:56 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-b77d6b3c-0fbf-457e-a75b-593662ec3d1a req-ddf0e57a-a36f-46af-a6c5-cd5edb716399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034545 Apr 18 09:26:56 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 147/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:27:36 user devstack@n-api.service[61594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 09:27:36 user devstack@n-api.service[61594]: Tue Apr 18 09:27:36 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 (ip 10.0.0.210) !!! Apr 18 09:27:36 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=12 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:36 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=16 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: 748ca482-c079-4ae8-8631-161a28648aa4] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.wsgi [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] HTTP exception thrown: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Request method failure captured: Apr 18 09:27:37 user devstack@n-api.service[61594]: request: GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 HTTP/1.1 Apr 18 09:27:37 user devstack@n-api.service[61594]: Accept: application/json Apr 18 09:27:37 user devstack@n-api.service[61594]: Accept-Encoding: identity Apr 18 09:27:37 user devstack@n-api.service[61594]: Connection: close Apr 18 09:27:37 user devstack@n-api.service[61594]: Content-Length: 0 Apr 18 09:27:37 user devstack@n-api.service[61594]: Content-Type: application/json Apr 18 09:27:37 user devstack@n-api.service[61594]: Host: 10.0.0.210 Apr 18 09:27:37 user devstack@n-api.service[61594]: Openstack-System-Scope: None Apr 18 09:27:37 user devstack@n-api.service[61594]: User-Agent: python-urllib3/1.26.15 Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Auth-Token: gAAAAABkPmHcg-DmkKbHh3uECDnPC65Le4e8vS5UV6jMkvq8gJy7ttv-NE3Hoi5MMMS5Mvm_IzNN3J4Aw5Qmjl4toBqIkrCAbUvrNHZQYHnrcP74d-yrgxU6eWc3Lh8KUgODbhkNM3J832jFHEeISN1G4sPgwWaOg2Qg3wFJdfN5GF8ffPKLCgQ Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Domain-Id: None Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Domain-Name: None Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Identity-Status: Confirmed Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Is-Admin-Project: True Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Project-Domain-Id: default Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Project-Domain-Name: Default Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Project-Id: aecaf307aca347b99ad4e2c3614c1d3d Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Project-Name: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Role: member,reader Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Roles: member,reader Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Tenant: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Tenant-Id: aecaf307aca347b99ad4e2c3614c1d3d Apr 18 09:27:37 user devstack@n-api.service[61594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:27:37 user devstack@n-api.service[61594]: X-User: tempest-TestMinimumBasicScenario-1189513204-project-member Apr 18 09:27:37 user devstack@n-api.service[61594]: X-User-Domain-Id: default Apr 18 09:27:37 user devstack@n-api.service[61594]: X-User-Domain-Name: Default Apr 18 09:27:37 user devstack@n-api.service[61594]: X-User-Id: 23183785a98e4e77aaf6c77e29d158b7 Apr 18 09:27:37 user devstack@n-api.service[61594]: X-User-Name: tempest-TestMinimumBasicScenario-1189513204-project-member Apr 18 09:27:37 user devstack@n-api.service[61594]: method: > Apr 18 09:27:37 user devstack@n-api.service[61594]: exception: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. Apr 18 09:27:37 user devstack@n-api.service[61594]: action_args: {'id': '748ca482-c079-4ae8-8631-161a28648aa4'} Apr 18 09:27:37 user devstack@n-api.service[61594]: {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. Apr 18 09:27:37 user devstack@n-api.service[61594]: ERROR nova.api.openstack.wsgi Apr 18 09:27:37 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Returning 404 to user: Instance 748ca482-c079-4ae8-8631-161a28648aa4 could not be found. {{(pid=61594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:27:37 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-c8d8a10e-cd6e-4185-858d-af3ba668cad8 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4" status: 404 len: 111 microversion: 2.1 time: 0.036360 Apr 18 09:27:37 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 147/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:27:36 2023] GET /compute/v2.1/servers/748ca482-c079-4ae8-8631-161a28648aa4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:27:37 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=4 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:37 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:37 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:37 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=20 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:37 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-309ae9d2-9cfc-4aec-be4f-97b5dbbf2ac5 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '.version_select at 0x7f0dce63e200>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:27:37 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-309ae9d2-9cfc-4aec-be4f-97b5dbbf2ac5 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-789238646" status: 202 len: 0 microversion: 2.1 time: 0.033211 Apr 18 09:27:37 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 144/438] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 18 09:27:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-789238646 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-d00b2246-d522-4959-95f4-7167230338db tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Action: 'create', calling method: .version_select at 0x7f0dce60b640>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1309670106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaU/adMqwx0vUO2HaNmnf24fQAblUVzWqVOTc5W27jhlfV32Lz30rnGa/a56qTqoNYawmt1ehnPThIqpxCO28C30wH8TOAhKxITXrkiPt7XW5ilfpzkL+LIHDhxFEmhqg=="}} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d00b2246-d522-4959-95f4-7167230338db tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:27:39 user devstack@n-api.service[61592]: DEBUG nova.quota [None req-d00b2246-d522-4959-95f4-7167230338db tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for user 23183785a98e4e77aaf6c77e29d158b7 and project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'key_pairs'} {{(pid=61592) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:27:39 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-d00b2246-d522-4959-95f4-7167230338db tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057018 Apr 18 09:27:39 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 148/439] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 09:27:39 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:27:39 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-911042726", "imageRef": "cadf6a58-df32-42b4-a759-f232053b16ce", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1309670106", "networks": [{"uuid": "c280e39a-43ab-49b9-b7a1-27276c7abd1c"}]}} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:27:39 user devstack@n-api.service[61594]: DEBUG nova.network.neutron [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] validate_networks() for [('c280e39a-43ab-49b9-b7a1-27276c7abd1c', None, None, None, None, None)] {{(pid=61594) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:39 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:40 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d52f1092d423bb8b7b4d6fb65a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad586fd06f4754b7bba571684cab0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:27:40 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-128c5adc-0764-47fc-a445-afbba9b05440 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20" status: 200 len: 1486 microversion: 2.1 time: 0.869280 Apr 18 09:27:40 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 145/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:27:39 2023] GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 => generated 1486 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Flavor limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Image limits 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Flavor pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Image pref 0:0:0 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.virt.hardware [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.quota [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Getting quotas for user 23183785a98e4e77aaf6c77e29d158b7 and project aecaf307aca347b99ad4e2c3614c1d3d. Resources: {'ram', 'instances', 'cores'} {{(pid=61594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Going to run 1 instances... {{(pid=61594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 09:27:40 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cadf6a58-df32-42b4-a759-f232053b16ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 09:27:40 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-b389af4a-8a1c-43f0-bbde-4c486d942894 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.276820 Apr 18 09:27:40 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 148/441] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 09:27:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 09:27:40 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-5c75a7f8-c0ff-4ff0-b099-658a1acb96c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:27:40 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-5c75a7f8-c0ff-4ff0-b099-658a1acb96c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:27:40 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-5c75a7f8-c0ff-4ff0-b099-658a1acb96c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:27:40 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-5c75a7f8-c0ff-4ff0-b099-658a1acb96c1 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 200 len: 1252 microversion: 2.1 time: 0.067833 Apr 18 09:27:40 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:27:40 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 1252 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:27:43 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:27:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:43 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:43 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] Creating event network-changed:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:27:43 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-fd0ac2e0-0f6d-4df8-838d-3eb70cac2b3f req-6d010053-174d-4b00-a569-2d56095fa234 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026746 Apr 18 09:27:43 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 146/443] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:27:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:27:45 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "name": "network-vif-plugged", "status": "completed", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:27:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:45 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:45 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] Creating event network-vif-plugged:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:27:45 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-318f9868-edb8-47b6-a2cf-8b5feffd9ca6 req-b407fc42-9ac3-443f-b4f9-cec19ba4f531 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Apr 18 09:27:45 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 149/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:27:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:27:47 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "name": "network-vif-plugged", "status": "completed", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:27:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:27:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:27:47 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:27:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] Creating event network-vif-plugged:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:27:47 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-b3eff0cf-eb24-4e35-8144-68d7a0912d8a req-5a2ce16a-c41b-4964-9dd6-8e7f71abdecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028592 Apr 18 09:27:47 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 150/445] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:27:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=8 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:30 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:31 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:28:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-1b163b83-48c6-4fce-8293-d9c52019dca3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 200 len: 1537 microversion: 2.1 time: 0.235809 Apr 18 09:28:31 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 147/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:28:30 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=2 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell0:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=6 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:42 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Going to try to terminate instance {{(pid=61594) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:28:42 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-ab4dc450-80c2-4b7b-bba4-78fbca84ce86 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20" status: 204 len: 0 microversion: 2.1 time: 0.123064 Apr 18 09:28:42 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 150/447] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:28:42 2023] DELETE /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell0:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61592]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 09:28:42 user devstack@n-api.service[61592]: Tue Apr 18 09:28:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 (ip 10.0.0.210) !!! Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "name": "network-vif-unplugged", "status": "completed", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:28:42 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d52f1092d423bb8b7b4d6fb65a740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad586fd06f4754b7bba571684cab0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=6 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:28:42 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-04af8eeb-21fb-450d-bada-9747fe4fecd9 tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20" status: 200 len: 1492 microversion: 2.1 time: 0.246544 Apr 18 09:28:42 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 151/448] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:28:42 2023] GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 => generated 1492 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:42 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:42 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] Creating event network-vif-unplugged:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:28:42 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-3530098c-060f-47de-90c8-53b538aa3468 req-39c59a07-36ce-4785-8222-9f1e62dd6003 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033299 Apr 18 09:28:42 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 148/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:28:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:28:44 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "name": "network-vif-plugged", "status": "completed", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}, {"server_uuid": "34f0ccd1-9d67-4875-a656-eb131b5d5d20", "name": "network-vif-deleted", "tag": "d97000c7-cc3f-4102-95f0-7031eb089ec2"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:28:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:28:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:28:44 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:28:44 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Creating event network-vif-plugged:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:28:44 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] Creating event network-vif-deleted:d97000c7-cc3f-4102-95f0-7031eb089ec2 for instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 on user Apr 18 09:28:44 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-ac50f943-8c3c-4c23-8c58-db9c6503f823 req-a458338d-c9ba-4ea3-b204-82af41af67b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030934 Apr 18 09:28:44 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 151/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=2 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61592]: DEBUG nova.policy [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61592) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:29:31 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-caef5e5f-43ed-41a2-8a02-350c901b8881 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 200 len: 1537 microversion: 2.1 time: 0.299828 Apr 18 09:29:31 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 152/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:29:31 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG nova.policy [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61593) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Searching by: {'deleted': False, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d'} {{(pid=61593) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 09:29:31 user devstack@n-api.service[61593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 09:29:31 user devstack@n-api.service[61593]: Tue Apr 18 09:29:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61593]: DEBUG nova.compute.multi_cell_list [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 09:29:31 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-c9e0c9fa-d834-445e-a9c3-902e810a022d tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.075159 Apr 18 09:29:31 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 149/452] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 09:29:31 2023] GET /compute/v2.1/servers => generated 340 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG dbcounter [-] [61594] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61594) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:31 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:29:31 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-e51bd675-6855-44a0-b224-39c3a2dca7b3 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 200 len: 1537 microversion: 2.1 time: 0.165085 Apr 18 09:29:31 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 152/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:29:31 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] [instance: 34f0ccd1-9d67-4875-a656-eb131b5d5d20] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] HTTP exception thrown: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Request method failure captured: Apr 18 09:29:32 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 HTTP/1.1 Apr 18 09:29:32 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:29:32 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:29:32 user devstack@n-api.service[61592]: Connection: close Apr 18 09:29:32 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:29:32 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:29:32 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:29:32 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:29:32 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmJXJ-sYnog0ug_pnsUsDEiU_YzjzXZy5CVfHD036gaGhFU8fH3afhYARYogee9-AF6jVOLd0MAgFteQVrzo7UD3Y1lRx9ljQv_Y7GxFJkvBz3qwpuyyreA2EXNczx-u-MpGns04wHhLV7Tl6uGYp1Eq-vt2Ft_YDkYqzSHunwy_Ot4 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Project-Id: 0cad586fd06f4754b7bba571684cab0b Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Project-Name: tempest-VolumesActionsTest-916213941 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cad586fd06f4754b7bba571684cab0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0cad586fd06f4754b7bba571684cab0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0cad586fd06f4754b7bba571684cab0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Tenant: tempest-VolumesActionsTest-916213941 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Tenant-Id: 0cad586fd06f4754b7bba571684cab0b Apr 18 09:29:32 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-VolumesActionsTest-916213941 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-User: tempest-VolumesActionsTest-916213941-project-member Apr 18 09:29:32 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:29:32 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:29:32 user devstack@n-api.service[61592]: X-User-Id: e92d52f1092d423bb8b7b4d6fb65a740 Apr 18 09:29:32 user devstack@n-api.service[61592]: X-User-Name: tempest-VolumesActionsTest-916213941-project-member Apr 18 09:29:32 user devstack@n-api.service[61592]: method: > Apr 18 09:29:32 user devstack@n-api.service[61592]: exception: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. Apr 18 09:29:32 user devstack@n-api.service[61592]: action_args: {'id': '34f0ccd1-9d67-4875-a656-eb131b5d5d20'} Apr 18 09:29:32 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. Apr 18 09:29:32 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:29:32 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] Returning 404 to user: Instance 34f0ccd1-9d67-4875-a656-eb131b5d5d20 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:29:32 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-ef224fd3-323c-4a0b-8fbb-c395acf071ab tempest-VolumesActionsTest-916213941 tempest-VolumesActionsTest-916213941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20" status: 404 len: 111 microversion: 2.1 time: 0.034871 Apr 18 09:29:32 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 153/454] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:29:32 2023] GET /compute/v2.1/servers/34f0ccd1-9d67-4875-a656-eb131b5d5d20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61593) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:33 user devstack@n-api.service[61593]: DEBUG nova.compute.api [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Going to try to terminate instance {{(pid=61593) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 09:29:33 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-130ffe18-3358-40a9-8aa1-f89dbd29df11 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 204 len: 0 microversion: 2.1 time: 0.114856 Apr 18 09:29:33 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 150/455] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 09:29:33 2023] DELETE /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG nova.compute.api [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61594) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:33 user devstack@n-api.service[61594]: DEBUG nova.policy [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23183785a98e4e77aaf6c77e29d158b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aecaf307aca347b99ad4e2c3614c1d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61594) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 09:29:33 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [None req-6dc74b87-42a1-438f-a356-b309d47852e7 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 200 len: 1543 microversion: 2.1 time: 0.210004 Apr 18 09:29:33 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 153/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:29:33 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 1543 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 09:29:33 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "name": "network-vif-unplugged", "status": "completed", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:29:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:33 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.compute.server_external_events [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] Creating event network-vif-unplugged:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:29:33 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [req-1584163d-2e38-498f-8ed2-33ab2b707a05 req-c301b06d-7b01-4a2f-9a78-bd951440f48e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030969 Apr 18 09:29:33 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 154/457] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:29:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:29:34 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "name": "network-vif-deleted", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:29:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:34 user devstack@n-api.service[61593]: DEBUG oslo_concurrency.lockutils [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61593) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:34 user devstack@n-api.service[61593]: INFO nova.api.openstack.compute.server_external_events [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] Creating event network-vif-deleted:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:29:34 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [req-5c4db41a-62bb-452e-a0e0-252c0cc0d788 req-3266cc2d-d492-4c1a-8fc3-b16b67742076 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075080 Apr 18 09:29:34 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 151/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:29:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:29:35 user devstack@n-api.service[61594]: DEBUG nova.api.openstack.wsgi [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c760a417-fa37-469f-877f-7a2c766863c2", "name": "network-vif-plugged", "status": "completed", "tag": "077d1332-9021-444a-8b02-5512fd77f530"}]} {{(pid=61594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 09:29:35 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:29:35 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:29:35 user devstack@n-api.service[61594]: DEBUG oslo_concurrency.lockutils [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61594) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:29:35 user devstack@n-api.service[61594]: INFO nova.api.openstack.compute.server_external_events [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] Creating event network-vif-plugged:077d1332-9021-444a-8b02-5512fd77f530 for instance c760a417-fa37-469f-877f-7a2c766863c2 on user Apr 18 09:29:35 user devstack@n-api.service[61594]: INFO nova.api.openstack.requestlog [req-1ab34e94-520d-43d0-a8a6-7fcbc59e65f8 req-1c521e8c-9ab4-4b71-868c-5a04c1628b0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027857 Apr 18 09:29:35 user devstack@n-api.service[61594]: [pid: 61594|app: 0|req: 154/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 09:29:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_api:SELECT=6 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG dbcounter [-] [61592] Writing DB stats nova_cell1:SELECT=10 {{(pid=61592) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:30:23 user devstack@n-api.service[61592]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 09:30:23 user devstack@n-api.service[61592]: Tue Apr 18 09:30:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 (ip 10.0.0.210) !!! Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '>' {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG nova.compute.api [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] [instance: c760a417-fa37-469f-877f-7a2c766863c2] Fetching instance by UUID {{(pid=61592) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Acquiring lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG oslo_concurrency.lockutils [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Lock "82f4d1d5-971d-40da-bb81-ed51efeb387d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61592) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 09:30:23 user devstack@n-api.service[61592]: INFO nova.api.openstack.wsgi [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] HTTP exception thrown: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Request method failure captured: Apr 18 09:30:23 user devstack@n-api.service[61592]: request: GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 HTTP/1.1 Apr 18 09:30:23 user devstack@n-api.service[61592]: Accept: application/json Apr 18 09:30:23 user devstack@n-api.service[61592]: Accept-Encoding: identity Apr 18 09:30:23 user devstack@n-api.service[61592]: Connection: close Apr 18 09:30:23 user devstack@n-api.service[61592]: Content-Length: 0 Apr 18 09:30:23 user devstack@n-api.service[61592]: Content-Type: application/json Apr 18 09:30:23 user devstack@n-api.service[61592]: Host: 10.0.0.210 Apr 18 09:30:23 user devstack@n-api.service[61592]: Openstack-System-Scope: None Apr 18 09:30:23 user devstack@n-api.service[61592]: User-Agent: python-urllib3/1.26.15 Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Auth-Token: gAAAAABkPmHcg-DmkKbHh3uECDnPC65Le4e8vS5UV6jMkvq8gJy7ttv-NE3Hoi5MMMS5Mvm_IzNN3J4Aw5Qmjl4toBqIkrCAbUvrNHZQYHnrcP74d-yrgxU6eWc3Lh8KUgODbhkNM3J832jFHEeISN1G4sPgwWaOg2Qg3wFJdfN5GF8ffPKLCgQ Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Domain-Id: None Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Domain-Name: None Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Identity-Status: Confirmed Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Is-Admin-Project: True Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Project-Domain-Id: default Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Project-Domain-Name: Default Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Project-Id: aecaf307aca347b99ad4e2c3614c1d3d Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Project-Name: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Role: member,reader Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Roles: member,reader Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aecaf307aca347b99ad4e2c3614c1d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Tenant: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Tenant-Id: aecaf307aca347b99ad4e2c3614c1d3d Apr 18 09:30:23 user devstack@n-api.service[61592]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1189513204 Apr 18 09:30:23 user devstack@n-api.service[61592]: X-User: tempest-TestMinimumBasicScenario-1189513204-project-member Apr 18 09:30:23 user devstack@n-api.service[61592]: X-User-Domain-Id: default Apr 18 09:30:23 user devstack@n-api.service[61592]: X-User-Domain-Name: Default Apr 18 09:30:23 user devstack@n-api.service[61592]: X-User-Id: 23183785a98e4e77aaf6c77e29d158b7 Apr 18 09:30:23 user devstack@n-api.service[61592]: X-User-Name: tempest-TestMinimumBasicScenario-1189513204-project-member Apr 18 09:30:23 user devstack@n-api.service[61592]: method: > Apr 18 09:30:23 user devstack@n-api.service[61592]: exception: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. Apr 18 09:30:23 user devstack@n-api.service[61592]: action_args: {'id': 'c760a417-fa37-469f-877f-7a2c766863c2'} Apr 18 09:30:23 user devstack@n-api.service[61592]: {{(pid=61592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. Apr 18 09:30:23 user devstack@n-api.service[61592]: ERROR nova.api.openstack.wsgi Apr 18 09:30:23 user devstack@n-api.service[61592]: DEBUG nova.api.openstack.wsgi [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Returning 404 to user: Instance c760a417-fa37-469f-877f-7a2c766863c2 could not be found. {{(pid=61592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 09:30:23 user devstack@n-api.service[61592]: INFO nova.api.openstack.requestlog [None req-b3bc3ae9-5ff0-48ea-8291-95e70692c718 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2" status: 404 len: 111 microversion: 2.1 time: 0.232140 Apr 18 09:30:23 user devstack@n-api.service[61592]: [pid: 61592|app: 0|req: 155/460] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 09:30:23 2023] GET /compute/v2.1/servers/c760a417-fa37-469f-877f-7a2c766863c2 => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 09:30:23 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell0:SELECT=2 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:30:23 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:30:23 user devstack@n-api.service[61593]: DEBUG dbcounter [-] [61593] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61593) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 09:30:23 user devstack@n-api.service[61593]: DEBUG nova.api.openstack.wsgi [None req-887b6437-eaf8-4893-bd62-a0dd1ea60e79 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] Calling method '.version_select at 0x7f0dce6af6d0>' {{(pid=61593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 09:30:23 user devstack@n-api.service[61593]: INFO nova.api.openstack.requestlog [None req-887b6437-eaf8-4893-bd62-a0dd1ea60e79 tempest-TestMinimumBasicScenario-1189513204 tempest-TestMinimumBasicScenario-1189513204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1309670106" status: 202 len: 0 microversion: 2.1 time: 0.038575 Apr 18 09:30:23 user devstack@n-api.service[61593]: [pid: 61593|app: 0|req: 152/461] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 09:30:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1309670106 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)