Apr 18 15:14:45 user devstack@n-api.service[61364]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 15:14:45 user devstack@n-api.service[61364]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 15:14:45 2023] *** Apr 18 15:14:45 user devstack@n-api.service[61364]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 15:14:45 user devstack@n-api.service[61364]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 15:14:45 user devstack@n-api.service[61364]: nodename: user Apr 18 15:14:45 user devstack@n-api.service[61364]: machine: x86_64 Apr 18 15:14:45 user devstack@n-api.service[61364]: clock source: unix Apr 18 15:14:45 user devstack@n-api.service[61364]: pcre jit disabled Apr 18 15:14:45 user devstack@n-api.service[61364]: detected number of CPU cores: 12 Apr 18 15:14:45 user devstack@n-api.service[61364]: current working directory: / Apr 18 15:14:45 user devstack@n-api.service[61364]: detected binary path: /usr/bin/uwsgi-core Apr 18 15:14:45 user devstack@n-api.service[61364]: your processes number limit is 63638 Apr 18 15:14:45 user devstack@n-api.service[61364]: your memory page size is 4096 bytes Apr 18 15:14:45 user devstack@n-api.service[61364]: detected max file descriptor number: 2048 Apr 18 15:14:45 user devstack@n-api.service[61364]: lock engine: pthread robust mutexes Apr 18 15:14:45 user devstack@n-api.service[61364]: thunder lock: enabled Apr 18 15:14:45 user devstack@n-api.service[61364]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 15:14:45 user devstack@n-api.service[61364]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 15:14:45 user devstack@n-api.service[61364]: Python main interpreter initialized at 0x556bea0ed990 Apr 18 15:14:45 user devstack@n-api.service[61364]: python threads support enabled Apr 18 15:14:45 user devstack@n-api.service[61364]: your server socket listen backlog is limited to 100 connections Apr 18 15:14:45 user devstack@n-api.service[61364]: your mercy for graceful operations on workers is 90 seconds Apr 18 15:14:45 user devstack@n-api.service[61364]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 15:14:45 user devstack@n-api.service[61364]: *** Operational MODE: preforking *** Apr 18 15:14:45 user devstack@n-api.service[61364]: *** uWSGI is running in multiple interpreter mode *** Apr 18 15:14:45 user devstack@n-api.service[61364]: spawned uWSGI master process (pid: 61364) Apr 18 15:14:45 user devstack@n-api.service[61364]: spawned uWSGI worker 1 (pid: 61365, cores: 1) Apr 18 15:14:45 user devstack@n-api.service[61364]: spawned uWSGI worker 2 (pid: 61366, cores: 1) Apr 18 15:14:45 user devstack@n-api.service[61364]: spawned uWSGI worker 3 (pid: 61367, cores: 1) Apr 18 15:14:45 user devstack@n-api.service[61364]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 15:14:46 user devstack@n-api.service[61367]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 15:14:46 user devstack@n-api.service[61366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 15:14:46 user devstack@n-api.service[61365]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 15:14:49 user devstack@n-api.service[61367]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 15:14:49 user devstack@n-api.service[61367]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 15:14:49 user devstack@n-api.service[61367]: and ``live_migration_inbound_addr`` respectively. Apr 18 15:14:49 user devstack@n-api.service[61367]: ). Its value may be silently ignored in the future. Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 15:14:50 user devstack@n-api.service[61366]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 15:14:50 user devstack@n-api.service[61366]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 15:14:50 user devstack@n-api.service[61366]: and ``live_migration_inbound_addr`` respectively. Apr 18 15:14:50 user devstack@n-api.service[61366]: ). Its value may be silently ignored in the future. Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 15:14:50 user devstack@n-api.service[61365]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 15:14:50 user devstack@n-api.service[61365]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 15:14:50 user devstack@n-api.service[61365]: and ``live_migration_inbound_addr`` respectively. Apr 18 15:14:50 user devstack@n-api.service[61365]: ). Its value may be silently ignored in the future. Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61367) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61366) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61367]: INFO dbcounter [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Registered counter for database nova_api Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61365) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_db.sqlalchemy.engines [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61367) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writer thread running {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: INFO dbcounter [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Registered counter for database nova_api Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.context [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d27f661e-81e7-4e06-bd8c-c3069818de01(cell1) {{(pid=61367) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61367]: INFO dbcounter [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61367]: INFO dbcounter [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Registered counter for database nova_cell1 Apr 18 15:14:50 user devstack@n-api.service[61365]: INFO dbcounter [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Registered counter for database nova_api Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_db.sqlalchemy.engines [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61367) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_db.sqlalchemy.engines [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61367) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writer thread running {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writer thread running {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG nova.context [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d27f661e-81e7-4e06-bd8c-c3069818de01(cell1) {{(pid=61366) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61366]: INFO dbcounter [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61366]: INFO dbcounter [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Registered counter for database nova_cell1 Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG nova.context [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d27f661e-81e7-4e06-bd8c-c3069818de01(cell1) {{(pid=61365) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:14:50 user devstack@n-api.service[61365]: INFO dbcounter [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61365]: INFO dbcounter [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Registered counter for database nova_cell1 Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61367]: INFO dbcounter [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG oslo_db.sqlalchemy.engines [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61367) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writer thread running {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: INFO dbcounter [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG oslo_db.sqlalchemy.engines [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61366) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writer thread running {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61365]: INFO dbcounter [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Registered counter for database nova_cell0 Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG oslo_db.sqlalchemy.engines [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61365) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 15:14:50 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writer thread running {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 15:14:50 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:50 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:50 user devstack@n-api.service[61367]: WARNING keystonemiddleware.auth_token [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:50 user devstack@n-api.service[61367]: WARNING keystonemiddleware.auth_token [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:50 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:50 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:50 user devstack@n-api.service[61367]: WARNING keystonemiddleware.auth_token [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:50 user devstack@n-api.service[61367]: WARNING keystonemiddleware.auth_token [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:50 user devstack@n-api.service[61367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556bea0ed990 pid: 61367 (default app) Apr 18 15:14:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:14:50 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001521 Apr 18 15:14:50 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 15:14:50 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:14:50 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:50 user devstack@n-api.service[61366]: WARNING keystonemiddleware.auth_token [None req-76edf96d-4b13-4001-b3f4-f5dc61ecfac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:50 user devstack@n-api.service[61366]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556bea0ed990 pid: 61366 (default app) Apr 18 15:14:51 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 15:14:51 user devstack@n-api.service[61365]: WARNING keystonemiddleware.auth_token [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 15:14:51 user devstack@n-api.service[61365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bea0ed990 pid: 61365 (default app) Apr 18 15:16:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:16:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-159460e6-ac11-442d-812c-bc89c7fc1f8a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001568 Apr 18 15:16:59 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:16:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:16:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:16:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:16:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:16:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:16:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-519bd7a8-b999-4233-baac-16921e77b6bf admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:16:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-519bd7a8-b999-4233-baac-16921e77b6bf admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.360683 Apr 18 15:16:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 15:16:59 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002079 Apr 18 15:17:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:01 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:01 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:01 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:01 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:01 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:02 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-9019e6ff-10dc-4f59-a994-dd4309a17c80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:02 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-9019e6ff-10dc-4f59-a994-dd4309a17c80 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.309716 Apr 18 15:17:02 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:01 2023] POST /compute/v2.1/flavors => generated 405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-70d625cd-10bd-4edb-9ad0-f0524fb6eb8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-70d625cd-10bd-4edb-9ad0-f0524fb6eb8f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051823 Apr 18 15:17:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 15:17:02 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:04 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:04 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001374 Apr 18 15:17:04 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:04 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e0d82adf-6816-434c-9232-feb727ff5657 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:04 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e0d82adf-6816-434c-9232-feb727ff5657 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061974 Apr 18 15:17:04 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:04 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-696e6946-2c4a-4282-8bb6-881b0124b67a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-696e6946-2c4a-4282-8bb6-881b0124b67a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029715 Apr 18 15:17:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 15:17:04 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001382 Apr 18 15:17:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:06 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-4aeed297-e5cf-40be-b35f-e640726721f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:06 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-4aeed297-e5cf-40be-b35f-e640726721f9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068532 Apr 18 15:17:06 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:06 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:06 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6f16c6a7-0230-4cde-a8de-ae227a8c1720 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:06 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6f16c6a7-0230-4cde-a8de-ae227a8c1720 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036429 Apr 18 15:17:06 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 15:17:06 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001417 Apr 18 15:17:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:08 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d403bb16-6c7e-43af-b190-10677c1bb493 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:08 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d403bb16-6c7e-43af-b190-10677c1bb493 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083331 Apr 18 15:17:08 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:08 2023] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ff0721f2-cce6-4386-a86c-bc2f200df7ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ff0721f2-cce6-4386-a86c-bc2f200df7ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024444 Apr 18 15:17:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 15:17:08 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:10 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001424 Apr 18 15:17:10 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:10 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-a9937699-1853-4e23-8fbd-d5bfe1505847 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 4, "id": "d4"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:10 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-a9937699-1853-4e23-8fbd-d5bfe1505847 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071171 Apr 18 15:17:10 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:10 2023] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:10 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:10 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033894 Apr 18 15:17:10 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 15:17:10 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a7ab3789-afdd-46ae-b155-e941e70c4622 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001830 Apr 18 15:17:12 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:12 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:12 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-dfc2411e-9e7b-4cd8-83ad-09911743aeec admin admin] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:12 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-dfc2411e-9e7b-4cd8-83ad-09911743aeec admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.078922 Apr 18 15:17:12 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 15:17:12 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:17:14 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:14 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001493 Apr 18 15:17:14 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:14 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:14 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:14 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:14 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:14 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dcd507f4-b39e-40e8-a0f7-fb3d378267ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "disk": 1}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dcd507f4-b39e-40e8-a0f7-fb3d378267ed admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.388698 Apr 18 15:17:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:14 2023] POST /compute/v2.1/flavors => generated 400 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 15:17:14 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-eebb27c3-aad7-459b-bef5-3c1864724d4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:14 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-eebb27c3-aad7-459b-bef5-3c1864724d4e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037668 Apr 18 15:17:14 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 15:17:14 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:16 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:16 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001399 Apr 18 15:17:16 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:16 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b7d35154-72fb-499a-8370-01dbb16664dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:16 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b7d35154-72fb-499a-8370-01dbb16664dc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068183 Apr 18 15:17:16 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:16 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-a79a0820-00d0-4324-ba18-c2c7ae3846f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:16 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-a79a0820-00d0-4324-ba18-c2c7ae3846f9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027980 Apr 18 15:17:16 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 15:17:16 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:18 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:18 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001343 Apr 18 15:17:18 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e36e84bb-0ef1-435b-9af6-6c8e7533583e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e36e84bb-0ef1-435b-9af6-6c8e7533583e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078993 Apr 18 15:17:18 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:18 2023] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:18 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-0842d87b-ce41-4ddd-9fa7-60d153400e55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:18 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-0842d87b-ce41-4ddd-9fa7-60d153400e55 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024716 Apr 18 15:17:18 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 15:17:18 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001348 Apr 18 15:17:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-5af7abb0-48cf-4692-a9fe-ee48a8757074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-5af7abb0-48cf-4692-a9fe-ee48a8757074 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066315 Apr 18 15:17:20 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:20 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-87f2dd5f-8ebc-47af-bbce-ac570f082884 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-87f2dd5f-8ebc-47af-bbce-ac570f082884 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023927 Apr 18 15:17:20 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 15:17:20 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 18 15:17:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 15:17:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-df1acc75-8cd2-4613-80b0-c7b745faa0b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-df1acc75-8cd2-4613-80b0-c7b745faa0b6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059813 Apr 18 15:17:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 15:17:22 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:17:22 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-abb80851-fb73-4bc1-912e-b3857c75ada3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:17:22 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-abb80851-fb73-4bc1-912e-b3857c75ada3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025187 Apr 18 15:17:22 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 15:17:22 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:17:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-534d3218-0edb-4165-9d8a-89c9fbca6c68 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002272 Apr 18 15:17:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 15:17:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:17:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:17:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.245743 Apr 18 15:17:53 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 15:17:53 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:18:24 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-abb80851-fb73-4bc1-912e-b3857c75ada3 admin admin] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:18:24 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-abb80851-fb73-4bc1-912e-b3857c75ada3 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002311 Apr 18 15:18:24 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 15:18:24 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:18:24 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:18:24 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ef1478a0-4307-4ae6-a7bc-ad1a17f0d466 admin admin] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:18:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ef1478a0-4307-4ae6-a7bc-ad1a17f0d466 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.063666 Apr 18 15:18:24 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 15:18:24 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:18:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:18:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002601 Apr 18 15:18:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 15:18:29 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:18:29 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:18:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-36de708d-00f1-484d-8270-2dab65998c5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "name": "m1.nano", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "42", "disk": 1, "swap": 0}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:18:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-36de708d-00f1-484d-8270-2dab65998c5d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062322 Apr 18 15:18:29 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 15:18:29 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:18:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-226be295-9f27-4e87-b2d4-b61fb1b758aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:18:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-226be295-9f27-4e87-b2d4-b61fb1b758aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025861 Apr 18 15:18:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 15:18:29 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:18:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:18:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a0ddacad-f8a3-4d61-876f-a12212231ba4 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001543 Apr 18 15:18:33 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 15:18:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:18:33 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-c93dcc32-2284-4bfa-964b-0c1c1d693211 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 192, "os-flavor-access:is_public": true, "name": "m1.micro"}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:18:33 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-c93dcc32-2284-4bfa-964b-0c1c1d693211 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066024 Apr 18 15:18:33 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 15:18:33 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:18:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-58ec9a20-9c70-4b39-a3da-f2754fde0434 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:18:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-58ec9a20-9c70-4b39-a3da-f2754fde0434 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029554 Apr 18 15:18:33 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 15:18:33 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:20:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:20:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:20:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:20:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-988458871", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "f1c4865b-6b7b-420d-b656-97f0fcf2284e"}]}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:20:59 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] validate_networks() for [('f1c4865b-6b7b-420d-b656-97f0fcf2284e', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:00 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:00 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-dcc1983e-6e58-4bd1-a0a8-389468a2b64a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: .version_select at 0x7fc26b99a710>, body: {"keypair": {"name": "tempest-keypair-1496363600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXdu2aBUMS6Tkp9/QPJT7jqc8IVmQGMEFuaE7JlulyyF0Fezm9/9qIFkFHgWUaScUm8urp0Uvwd0X5fycmWXtywIZQkMNslSpQxjZSevGvM2bxbbiYPlXre3hxMiNx5yQ=="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:00 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-dcc1983e-6e58-4bd1-a0a8-389468a2b64a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:00 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-dcc1983e-6e58-4bd1-a0a8-389468a2b64a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:00 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-dcc1983e-6e58-4bd1-a0a8-389468a2b64a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.264774 Apr 18 15:21:00 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 17/46] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:21:00 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Getting quotas for project 5c48b75a2d654c548352e0e9d5552742. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Getting quotas for user 35c59aa3ad6e42f2989f045fbe926d9d and project 5c48b75a2d654c548352e0e9d5552742. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:01 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-934f282a-8491-4e98-a88d-616a228ff835 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.581062 Apr 18 15:21:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 15/47] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:20:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 2583 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:01 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:01 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c1d5292f-3e13-435d-911a-fe2af460a6af tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c1d5292f-3e13-435d-911a-fe2af460a6af tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:02 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c1d5292f-3e13-435d-911a-fe2af460a6af tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c59aa3ad6e42f2989f045fbe926d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c48b75a2d654c548352e0e9d5552742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c1d5292f-3e13-435d-911a-fe2af460a6af tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28" status: 200 len: 1208 microversion: 2.1 time: 0.773455 Apr 18 15:21:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:01 2023] GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 => generated 1208 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:04 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2091599920", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "43382397-0fa6-439e-8b5e-88a4313fb3de"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:04 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] validate_networks() for [('43382397-0fa6-439e-8b5e-88a4313fb3de', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:05 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1557769050", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "03193d32-3e21-4e7c-ae10-c5ddd6544407"}], "security_groups": [{"name": "tempest-securitygroup--1363688396"}], "key_name": "tempest-keypair-1496363600", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:05 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] validate_networks() for [('03193d32-3e21-4e7c-ae10-c5ddd6544407', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Getting quotas for project ebf08f40b0da4ad7b2b8fdb2834d464b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Getting quotas for user 99cb7e246c95430e8324dfa9ee5dd10f and project ebf08f40b0da4ad7b2b8fdb2834d464b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:06 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:07 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-91ed0e0d-c7ac-4831-a35c-5684ee45704c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.970711 Apr 18 15:21:07 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 18/49] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 2973 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:07 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d10f1811-6848-40c1-87ca-430d4b67abda tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:07 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d10f1811-6848-40c1-87ca-430d4b67abda tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:07 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-d10f1811-6848-40c1-87ca-430d4b67abda tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d10f1811-6848-40c1-87ca-430d4b67abda tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1211 microversion: 2.1 time: 0.091363 Apr 18 15:21:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:07 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:07 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-89be1886-64c2-4eae-b0f9-0c525b3ed78e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.206628 Apr 18 15:21:07 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 16/51] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:05 2023] POST /compute/v2.1/servers => generated 400 bytes in 2210 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:07 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-8d07fb7e-1624-42c1-8177-257bc16e5ef3 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:07 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-8d07fb7e-1624-42c1-8177-257bc16e5ef3 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:07 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-8d07fb7e-1624-42c1-8177-257bc16e5ef3 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:07 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-8d07fb7e-1624-42c1-8177-257bc16e5ef3 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 200 len: 1236 microversion: 2.1 time: 0.164430 Apr 18 15:21:07 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 19/52] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:07 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 1236 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6ed23f67-4f00-4448-b716-935e5f3865ca tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Action: 'create', calling method: .version_select at 0x7fc26b807640>, body: {"keypair": {"name": "tempest-keypair-2117243910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByhV4QdAUWAAua5zzEDT2XtzeH+e6UXWZB1tOsDbYKxNuHT4XYvLeygb3b4DwaN6OsqebVOCHdpZFxB+vLUG3sw2GYF4hq0JDhjNOYz7VBkz+vXbbd5anmG3DfPNd5j4g=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:08 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-6ed23f67-4f00-4448-b716-935e5f3865ca tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for project 7269241b8f244a86b51580dd6319d5c6. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:08 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-6ed23f67-4f00-4448-b716-935e5f3865ca tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for user c133acd96c98486fac2085187824d10b and project 7269241b8f244a86b51580dd6319d5c6. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6ed23f67-4f00-4448-b716-935e5f3865ca tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.375697 Apr 18 15:21:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 18/53] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:21:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Creating event network-changed:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-60606000-a747-48fb-8a13-2529bd11446d req-4a9c803e-9eea-4d05-be80-fa6da93b30d3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:09 user devstack@n-api.service[61365]: INFO nova.compute.rpcapi [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 15:21:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] Releasing lock "compute-rpcapi-router" {{(pid=61365) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 15:21:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f0df0c4b-d6cd-4ed1-bf45-b177c1f680bd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185850 Apr 18 15:21:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 17/54] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:13 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1266013552", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5fec6c8b-49b1-4298-a7ee-886f04baa0e2"}], "security_groups": [{"name": "tempest-securitygroup--967404536"}], "key_name": "tempest-keypair-2117243910", "user_data": "}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:13 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] validate_networks() for [('5fec6c8b-49b1-4298-a7ee-886f04baa0e2', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for project 7269241b8f244a86b51580dd6319d5c6. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for user c133acd96c98486fac2085187824d10b and project 7269241b8f244a86b51580dd6319d5c6. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:14 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:14 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "name": "network-vif-plugged", "status": "completed", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] Creating event network-vif-plugged:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:21:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-76cb2ed4-5c24-4900-8a7b-921a7684fdb4 req-63829f52-fdce-4a53-8b1a-8d79a43bfcd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100341 Apr 18 15:21:15 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 18/55] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:21:15 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Creating event network-changed:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-ffdc0c86-6296-4130-bbf6-92d1da84d3bf req-b807e85a-db1c-42c8-8fdb-35b44786ffb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:15 user devstack@n-api.service[61366]: INFO nova.compute.rpcapi [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 15:21:15 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] Releasing lock "compute-rpcapi-router" {{(pid=61366) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 15:21:15 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-fe711407-7b04-4e4a-a6dd-ed48b4dc627f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146130 Apr 18 15:21:15 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 19/56] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:15 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-87f33d21-da70-4cd0-8e94-8111aa560124 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.953189 Apr 18 15:21:15 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 20/57] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-99c8a648-0a4c-4921-95ea-c33c36de3a35 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-99c8a648-0a4c-4921-95ea-c33c36de3a35 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:15 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-99c8a648-0a4c-4921-95ea-c33c36de3a35 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:15 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-99c8a648-0a4c-4921-95ea-c33c36de3a35 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 200 len: 1232 microversion: 2.1 time: 0.222137 Apr 18 15:21:15 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:15 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 1232 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:17 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}, {"server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "name": "network-vif-plugged", "status": "completed", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:17 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:17 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:17 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:17 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Creating event network-changed:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:21:17 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] Creating event network-vif-plugged:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:21:17 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-970c10ae-e762-47be-92ff-09bdc213135a req-f6bb9542-8cee-4c4a-9b43-7ca6312ad815 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051359 Apr 18 15:21:17 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "name": "network-vif-plugged", "status": "completed", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:20 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] Creating event network-vif-plugged:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:21:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-ae6db61e-a4a8-4d9b-af42-ec1a18ae754a req-426ff0a9-e479-4cb9-9010-213bfa6b5523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078678 Apr 18 15:21:20 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Creating event network-vif-plugged:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61367) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2d4ca265-165e-4a62-90d2-dd1d9575a91e req-63d073ab-d279-4e49-9fc9-a995404254e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61367) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:20 user devstack@n-api.service[61367]: INFO nova.compute.rpcapi [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 15:21:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61367) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 15:21:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2737f44f-909e-49f3-810f-415ddc3c21d5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148923 Apr 18 15:21:20 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:22 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "name": "network-vif-plugged", "status": "completed", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}, {"name": "network-changed", "server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Creating event network-vif-plugged:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:21:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] Creating event network-changed:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:21:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-425a9e78-ce7d-4a4c-9c2e-6654708de0c9 req-8815d9da-3edd-42de-9396-04b57746c2f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045523 Apr 18 15:21:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:22 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] Creating event network-vif-plugged:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:21:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-367586e8-a2c9-4817-9210-1f33023b06b3 req-f26e34e3-5953-4f12-8a4d-3b9aae57c2bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096097 Apr 18 15:21:23 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:24 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "name": "network-vif-plugged", "status": "completed", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}, {"server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "name": "network-vif-plugged", "status": "completed", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:24 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:24 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:24 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:24 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=18 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:24 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Creating event network-vif-plugged:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:21:24 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] Creating event network-vif-plugged:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:21:24 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-5dabe1e0-6571-4aa6-ae8e-c9a96e4d7697 req-7c7f9152-351f-48ff-b2f1-d8d07bb335d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055482 Apr 18 15:21:24 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:26 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1183139627", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "037139ae-764a-4244-95a2-b72008920c25"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:26 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] validate_networks() for [('037139ae-764a-4244-95a2-b72008920c25', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Getting quotas for project c46068c4f77148359db56e2a79acb5d6. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Getting quotas for user 205cbab58b18431da5cded85339cdf51 and project c46068c4f77148359db56e2a79acb5d6. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-4edafdbb-9b89-4b40-82ac-e0e29db1f4dd tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.673546 Apr 18 15:21:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 2676 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:29 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=14 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f3432535-1526-4120-b9a2-5e3840bfa781 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-f3432535-1526-4120-b9a2-5e3840bfa781 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:29 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-f3432535-1526-4120-b9a2-5e3840bfa781 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205cbab58b18431da5cded85339cdf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46068c4f77148359db56e2a79acb5d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f3432535-1526-4120-b9a2-5e3840bfa781 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f" status: 200 len: 1208 microversion: 2.1 time: 0.193296 Apr 18 15:21:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:29 2023] GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f => generated 1208 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f3b76a3f-cb81-4a0c-9e0b-63e1757212d4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Action: 'create', calling method: .version_select at 0x7fc26b8f7f40>, body: {"keypair": {"name": "tempest-keypair-66129059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy9TpJbN5yXS8t/UyAflNviLK4skgj1P2zWCLGyOG4HphNDy/nDLp3BKvn+/WMVYzTY4g9HWStleevJrMxJqvvZECZ7XjDXB6I41Z6vymkImMIjvNPnQR1iAOQ0SDQ53g=="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:30 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f3b76a3f-cb81-4a0c-9e0b-63e1757212d4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Getting quotas for project 6dd5f52f6ac845babf10dec78710ad3c. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:30 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f3b76a3f-cb81-4a0c-9e0b-63e1757212d4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Getting quotas for user ce463e5c38a846fd82b0829eaa51831a and project 6dd5f52f6ac845babf10dec78710ad3c. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f3b76a3f-cb81-4a0c-9e0b-63e1757212d4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.346559 Apr 18 15:21:30 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:21:30 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-402601108", "imageRef": "05813231-e0c2-46d1-aef2-7c931ca0bee8", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3fc895e6-d8e6-44a8-879d-328e9164d8d5"}], "security_groups": [{"name": "tempest-securitygroup--843479447"}], "key_name": "tempest-keypair-66129059", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:34 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:35 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] validate_networks() for [('3fc895e6-d8e6-44a8-879d-328e9164d8d5', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=14 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-2d6f0326-6b8e-4b97-8304-aefbd6e1062b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Action: 'create', calling method: .version_select at 0x7fc26af770a0>, body: {"keypair": {"name": "tempest-keypair-137830134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZZTrZ+YKJnfgUDzjW9bX8cglLxCBoY9x/E6rvGmSySDhIdZZxF4VaazH+tOc3ImwRwI5bEoOeVSV82E+anIAX1wZ77Cp/urFLVAbL8BZdys34ajVsgV5K6CZ8vLAN64g=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:36 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2d6f0326-6b8e-4b97-8304-aefbd6e1062b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:36 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2d6f0326-6b8e-4b97-8304-aefbd6e1062b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for user fb1187e621234a18a337d8bae5c59ec3 and project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2d6f0326-6b8e-4b97-8304-aefbd6e1062b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.341673 Apr 18 15:21:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:21:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Getting quotas for project 6dd5f52f6ac845babf10dec78710ad3c. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Getting quotas for user ce463e5c38a846fd82b0829eaa51831a and project 6dd5f52f6ac845babf10dec78710ad3c. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:36 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='05813231-e0c2-46d1-aef2-7c931ca0bee8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:36 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8e4ccf0a-bf7e-4709-b58a-86a6ea0f169f tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.896952 Apr 18 15:21:36 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:34 2023] POST /compute/v2.1/servers => generated 403 bytes in 1899 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d92fff13-435d-4a7b-92fa-12ba0f25aeb2 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-d92fff13-435d-4a7b-92fa-12ba0f25aeb2 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=10 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:36 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-d92fff13-435d-4a7b-92fa-12ba0f25aeb2 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce463e5c38a846fd82b0829eaa51831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd5f52f6ac845babf10dec78710ad3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:36 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d92fff13-435d-4a7b-92fa-12ba0f25aeb2 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 200 len: 1237 microversion: 2.1 time: 0.144338 Apr 18 15:21:36 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 24/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:36 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] Creating event network-changed:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:21:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-733817fa-a8fc-4b38-87c1-ea57e112dbb2 req-8e605335-6bdd-4aff-8959-cb2c8c4696e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031996 Apr 18 15:21:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] Creating event network-changed:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:21:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-75c96ff8-6c7c-4def-8614-077e80893b6a req-851d1ce4-07a2-4953-8e4a-c7113646a05e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068994 Apr 18 15:21:40 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:41 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:21:41 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-a140e99a-b655-4b43-a8a6-fa0fc7a3103f req-2ba38b50-edeb-4fbe-b13a-7e4443518ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042254 Apr 18 15:21:41 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:21:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-2a6eddd9-7601-4c34-8ed7-a393bff5e37e req-9c14deda-d160-4b6d-aec9-a39c4f3d2ac9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Apr 18 15:21:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:43 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2075437977", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "70f00798-af6a-4eb7-b15c-89b7a38f573e"}], "security_groups": [{"name": "tempest-securitygroup--395091987"}], "key_name": "tempest-keypair-137830134", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:43 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] validate_networks() for [('70f00798-af6a-4eb7-b15c-89b7a38f573e', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for user fb1187e621234a18a337d8bae5c59ec3 and project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c80100ac-c2eb-40d1-9a79-ff263ca6f30b tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.037150 Apr 18 15:21:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-3a07858c-f145-4012-bd26-452f5e18853f tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:44 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-3a07858c-f145-4012-bd26-452f5e18853f tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:44 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-3a07858c-f145-4012-bd26-452f5e18853f tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-3a07858c-f145-4012-bd26-452f5e18853f tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd" status: 200 len: 1235 microversion: 2.1 time: 0.070869 Apr 18 15:21:44 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:44 2023] GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd => generated 1235 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "name": "network-vif-plugged", "status": "completed", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] Creating event network-vif-plugged:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:21:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-eee51c26-4736-454b-882d-b4884474c5a3 req-9c98a247-4014-4bfc-ac7e-23e705155b6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071397 Apr 18 15:21:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "name": "network-vif-plugged", "status": "completed", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:46 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] Creating event network-vif-plugged:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:21:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c8015eaf-a2a9-4bed-b43f-dd16a64b3146 req-77004818-56ce-4187-acff-060ac3eb839f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047689 Apr 18 15:21:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] Creating event network-changed:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:21:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-2acc6053-8fc1-41ef-b889-bfd2fb43cd46 req-2300ef62-6c06-4aba-84d6-51821a86e5e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061183 Apr 18 15:21:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-64fbc6df-95a5-423b-9133-6dc00e265e60 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Action: 'create', calling method: .version_select at 0x7fc26af76200>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-107712501"}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-64fbc6df-95a5-423b-9133-6dc00e265e60 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.681204 Apr 18 15:21:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 27/80] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 15:21:49 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 684 msecs (HTTP/1.1 200) 10 headers in 447 bytes (2 switches on core 0) Apr 18 15:21:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-b24b6f2f-c048-4313-ad0b-474474b39604 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Calling method '.version_select at 0x7fc26b746ef0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-b24b6f2f-c048-4313-ad0b-474474b39604 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671" status: 200 len: 344 microversion: 2.1 time: 0.113888 Apr 18 15:21:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:21:50 2023] GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671 => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:51 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-b1ab9ea1-55fb-4b3f-8ed4-dbe9b3bca6b7 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Calling method '.version_select at 0x7fc26b8f7e20>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-b1ab9ea1-55fb-4b3f-8ed4-dbe9b3bca6b7 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671" status: 200 len: 341 microversion: 2.1 time: 0.103956 Apr 18 15:21:51 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:21:51 2023] GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671 => generated 341 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-627bc1bc-f592-4bda-aea8-2055453bf88c tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Calling method '.version_select at 0x7fc26ae08700>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-627bc1bc-f592-4bda-aea8-2055453bf88c tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671" status: 202 len: 0 microversion: 2.1 time: 0.138569 Apr 18 15:21:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:21:51 2023] DELETE /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:21:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a9b7a189-edca-4010-83a5-8d4f14008f78 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Calling method '.version_select at 0x7fc26b7ff7f0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-a9b7a189-edca-4010-83a5-8d4f14008f78 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] HTTP exception thrown: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. Apr 18 15:21:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a9b7a189-edca-4010-83a5-8d4f14008f78 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Request method failure captured: Apr 18 15:21:52 user devstack@n-api.service[61366]: request: GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671 HTTP/1.1 Apr 18 15:21:52 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:21:52 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:21:52 user devstack@n-api.service[61366]: Connection: close Apr 18 15:21:52 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:21:52 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:21:52 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:21:52 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:21:52 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWNLTQvIGRe0S3yOypsfwB9M_yNzxmkMkf1xAKHlfYE0Dasp-37oh-akpTUzR1XD-OiG5qBQfLW_6BDtDbR12yRkjJtKDgRULlkc25cw52sGeFltTOGols_MRV7fPv2t6ZEV3OkebdlkcO_aBRZ2fmKg70c2hEv0pELTqnrsqrb9Gg Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Project-Id: 3db8f733d483474589f69e85af38a406 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-648872576 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3db8f733d483474589f69e85af38a406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3db8f733d483474589f69e85af38a406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3db8f733d483474589f69e85af38a406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesSnapshotsTestJSON-648872576 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Tenant-Id: 3db8f733d483474589f69e85af38a406 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-648872576 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-User: tempest-VolumesSnapshotsTestJSON-648872576-project-member Apr 18 15:21:52 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:21:52 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:21:52 user devstack@n-api.service[61366]: X-User-Id: 884023cb3d1c46da94a9ea5f64e78788 Apr 18 15:21:52 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesSnapshotsTestJSON-648872576-project-member Apr 18 15:21:52 user devstack@n-api.service[61366]: method: Apr 18 15:21:52 user devstack@n-api.service[61366]: exception: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. Apr 18 15:21:52 user devstack@n-api.service[61366]: action_args: {'id': '3ba4eba3-7126-4729-ad34-d9761b0a7671'} Apr 18 15:21:52 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. (HTTP 404) (Request-ID: req-83c95efc-7ccd-406d-8516-a5639a951759) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. Apr 18 15:21:52 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a9b7a189-edca-4010-83a5-8d4f14008f78 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] Returning 404 to user: Volume 3ba4eba3-7126-4729-ad34-d9761b0a7671 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a9b7a189-edca-4010-83a5-8d4f14008f78 tempest-VolumesSnapshotsTestJSON-648872576 tempest-VolumesSnapshotsTestJSON-648872576-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671" status: 404 len: 109 microversion: 2.1 time: 0.048609 Apr 18 15:21:52 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:21:52 2023] GET /compute/v2.1/os-volumes/3ba4eba3-7126-4729-ad34-d9761b0a7671 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:53 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c59aa3ad6e42f2989f045fbe926d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c48b75a2d654c548352e0e9d5552742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:53 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-efc76584-63d2-4bce-9558-d7d294a32ed1 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28" status: 200 len: 1489 microversion: 2.1 time: 0.582537 Apr 18 15:21:53 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:52 2023] GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 => generated 1489 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 15:21:53 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:53 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:21:53 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-85669652-f935-465d-9909-5e666b483c41 req-84683ecb-ca31-4a6b-b02c-7a8066cfcc6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058856 Apr 18 15:21:53 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=18 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-450e600c-2dea-4782-b614-e6e59da9071a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Action: 'create', calling method: .version_select at 0x7fc26b7ffd00>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1802310583", "metadata": {"Type": "work"}}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-450e600c-2dea-4782-b614-e6e59da9071a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:54 user devstack@n-api.service[61366]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 15:21:54 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:21:54 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:21:54 user devstack@n-api.service[61366]: Connection: close Apr 18 15:21:54 user devstack@n-api.service[61366]: Content-Length: 122 Apr 18 15:21:54 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:21:54 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:21:54 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:21:54 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61366]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61366]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:54 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61366]: Apr 18 15:21:54 user devstack@n-api.service[61366]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1802310583", "metadata": {"Type": "work"}}} Apr 18 15:21:54 user devstack@n-api.service[61366]: method: Apr 18 15:21:54 user devstack@n-api.service[61366]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61366]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802310583', 'metadata': {'Type': 'work'}}}} Apr 18 15:21:54 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise error Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-450e600c-2dea-4782-b614-e6e59da9071a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:54 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-450e600c-2dea-4782-b614-e6e59da9071a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.269016 Apr 18 15:21:54 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 15:21:54 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 18 15:21:54 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-dbb340c4-bca9-463a-9abf-2c0f0c819319 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Action: 'create', calling method: .version_select at 0x7fc26af8ecb0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1324170601", "metadata": {"Type": "work"}}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:54 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-dbb340c4-bca9-463a-9abf-2c0f0c819319 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:54 user devstack@n-api.service[61367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 15:21:54 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:21:54 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:21:54 user devstack@n-api.service[61367]: Connection: close Apr 18 15:21:54 user devstack@n-api.service[61367]: Content-Length: 120 Apr 18 15:21:54 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:21:54 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:21:54 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:21:54 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61367]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61367]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:54 user devstack@n-api.service[61367]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61367]: Apr 18 15:21:54 user devstack@n-api.service[61367]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1324170601", "metadata": {"Type": "work"}}} Apr 18 15:21:54 user devstack@n-api.service[61367]: method: Apr 18 15:21:54 user devstack@n-api.service[61367]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 15:21:54 user devstack@n-api.service[61367]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1324170601', 'metadata': {'Type': 'work'}}}} Apr 18 15:21:54 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise error Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi '0' Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 15:21:54 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-dbb340c4-bca9-463a-9abf-2c0f0c819319 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:54 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-dbb340c4-bca9-463a-9abf-2c0f0c819319 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018505 Apr 18 15:21:54 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 30/88] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 15:21:54 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:21:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-cc8645be-d3c2-4741-98b5-f85d2eb5de20 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Action: 'create', calling method: .version_select at 0x7fc26ae08d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-110013004", "metadata": {"Type": "work"}}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-cc8645be-d3c2-4741-98b5-f85d2eb5de20 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:54 user devstack@n-api.service[61365]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 15:21:54 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:21:54 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:21:54 user devstack@n-api.service[61365]: Connection: close Apr 18 15:21:54 user devstack@n-api.service[61365]: Content-Length: 118 Apr 18 15:21:54 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:21:54 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:21:54 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:21:54 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:54 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:54 user devstack@n-api.service[61365]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:21:54 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:21:54 user devstack@n-api.service[61365]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:54 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:54 user devstack@n-api.service[61365]: Apr 18 15:21:54 user devstack@n-api.service[61365]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-110013004", "metadata": {"Type": "work"}}} Apr 18 15:21:54 user devstack@n-api.service[61365]: method: Apr 18 15:21:54 user devstack@n-api.service[61365]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61365]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-110013004', 'metadata': {'Type': 'work'}}}} Apr 18 15:21:54 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise error Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi '' Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 15:21:54 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-cc8645be-d3c2-4741-98b5-f85d2eb5de20 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-cc8645be-d3c2-4741-98b5-f85d2eb5de20 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017120 Apr 18 15:21:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 30/89] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 15:21:54 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:21:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2c35d3eb-6a0d-4e12-aaca-72e256e54bfc tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Calling method '.version_select at 0x7fc26b7ffa30>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-2c35d3eb-6a0d-4e12-aaca-72e256e54bfc tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] HTTP exception thrown: Volume tempest-invalid-122099252 could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2c35d3eb-6a0d-4e12-aaca-72e256e54bfc tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:55 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-122099252 HTTP/1.1 Apr 18 15:21:55 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:21:55 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:21:55 user devstack@n-api.service[61366]: Connection: close Apr 18 15:21:55 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:21:55 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:21:55 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:21:55 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:21:55 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61366]: method: Apr 18 15:21:55 user devstack@n-api.service[61366]: exception: Volume tempest-invalid-122099252 could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: action_args: {'id': 'tempest-invalid-122099252'} Apr 18 15:21:55 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-122099252 could not be found. (HTTP 404) (Request-ID: req-11a443d2-0069-46c7-b706-4b796cb0ba3e) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-122099252 could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-122099252 could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-122099252 could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2c35d3eb-6a0d-4e12-aaca-72e256e54bfc tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 404 to user: Volume tempest-invalid-122099252 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2c35d3eb-6a0d-4e12-aaca-72e256e54bfc tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-122099252" status: 404 len: 98 microversion: 2.1 time: 0.050070 Apr 18 15:21:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 15:21:54 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-122099252 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f5178019-e1db-413a-8e9e-64ebef12722a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Action: 'create', calling method: .version_select at 0x7fc26ae29cf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-781805728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIWcmpG36CIKUc+ZjGZJsKflEOszlvud5uPJJPjoC+qj8F+PgG4dP6IYY9bOXZOTQYESZ3FxoGoGgC0jU5LjCm64UsL2JAb6ZMTPtJ2TlONnr7zv7COv88VpeBBoocEww=="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:21:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fd6a9c3f-5e03-4999-906d-7a9b81f863bf tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012941 Apr 18 15:21:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 31/91] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 15:21:55 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8e485bf0-042e-4825-a401-aefc4af49391 tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006483 Apr 18 15:21:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 31/92] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 15:21:55 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f5178019-e1db-413a-8e9e-64ebef12722a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f5178019-e1db-413a-8e9e-64ebef12722a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for user ff9093e866924885b8b5cf1893f69b49 and project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9c2f0fa5-7e62-4bb7-912a-807d83b05e1a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Calling method '.version_select at 0x7fc26c3e3d90>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:55 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f5178019-e1db-413a-8e9e-64ebef12722a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.082721 Apr 18 15:21:55 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:21:55 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-9c2f0fa5-7e62-4bb7-912a-807d83b05e1a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] HTTP exception thrown: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9c2f0fa5-7e62-4bb7-912a-807d83b05e1a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:55 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/os-volumes/d44096ec-0bd0-46a2-b1d8-31d88796a98f HTTP/1.1 Apr 18 15:21:55 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:21:55 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:21:55 user devstack@n-api.service[61365]: Connection: close Apr 18 15:21:55 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:21:55 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:21:55 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:21:55 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:21:55 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61365]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61365]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:55 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61365]: method: Apr 18 15:21:55 user devstack@n-api.service[61365]: exception: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. Apr 18 15:21:55 user devstack@n-api.service[61365]: action_args: {'id': 'd44096ec-0bd0-46a2-b1d8-31d88796a98f'} Apr 18 15:21:55 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. (HTTP 404) (Request-ID: req-079dd117-fc1d-4855-ad69-678140127e7e) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. Apr 18 15:21:55 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9c2f0fa5-7e62-4bb7-912a-807d83b05e1a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 404 to user: Volume d44096ec-0bd0-46a2-b1d8-31d88796a98f could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9c2f0fa5-7e62-4bb7-912a-807d83b05e1a tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d44096ec-0bd0-46a2-b1d8-31d88796a98f" status: 404 len: 109 microversion: 2.1 time: 0.052311 Apr 18 15:21:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:21:55 2023] DELETE /compute/v2.1/os-volumes/d44096ec-0bd0-46a2-b1d8-31d88796a98f => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22a32857-287b-40c0-8bcd-da3e3a57c57b tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Calling method '.version_select at 0x7fc26ae80160>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-22a32857-287b-40c0-8bcd-da3e3a57c57b tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] HTTP exception thrown: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22a32857-287b-40c0-8bcd-da3e3a57c57b tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Request method failure captured: Apr 18 15:21:55 user devstack@n-api.service[61366]: request: GET /compute/v2.1/os-volumes/7824c16d-5c73-4f95-bd14-89d4abffa6fb HTTP/1.1 Apr 18 15:21:55 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:21:55 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:21:55 user devstack@n-api.service[61366]: Connection: close Apr 18 15:21:55 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:21:55 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:21:55 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:21:55 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:21:55 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWSuwV9EtmOpHNMO5ZXB5qGHzl0oGIN1V6zRv64RDhRCfbQ3k4wSjvlBvhJ2zIJDHGqET-YvtneFl5dzVlR4ygh9iEg8N-IODAL1Wm2lGrU-dVowu4tQpLjrWCuOoRu8JrWYoO2jt97QCJVHXjz8Rtx7MIsCmdkhkPydfCIhI03fNs Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4ba6a574dab4b80948bfb0d8575f4ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant-Id: f4ba6a574dab4b80948bfb0d8575f4ac Apr 18 15:21:55 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesNegativeTest-1338860075 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Id: 69564771da2548aaa66d9f0290ada833 Apr 18 15:21:55 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesNegativeTest-1338860075-project-member Apr 18 15:21:55 user devstack@n-api.service[61366]: method: Apr 18 15:21:55 user devstack@n-api.service[61366]: exception: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: action_args: {'id': '7824c16d-5c73-4f95-bd14-89d4abffa6fb'} Apr 18 15:21:55 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. (HTTP 404) (Request-ID: req-8d6a95cf-ae33-4629-bb48-549a47a30fa0) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. Apr 18 15:21:55 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:21:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22a32857-287b-40c0-8bcd-da3e3a57c57b tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] Returning 404 to user: Volume 7824c16d-5c73-4f95-bd14-89d4abffa6fb could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:21:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-22a32857-287b-40c0-8bcd-da3e3a57c57b tempest-VolumesNegativeTest-1338860075 tempest-VolumesNegativeTest-1338860075-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7824c16d-5c73-4f95-bd14-89d4abffa6fb" status: 404 len: 109 microversion: 2.1 time: 0.058381 Apr 18 15:21:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:21:55 2023] GET /compute/v2.1/os-volumes/7824c16d-5c73-4f95-bd14-89d4abffa6fb => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1733164282", "imageRef": "1bb8574d-66fe-409e-a6e6-9d4b57f7eb0e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-781805728", "networks": [{"uuid": "5eb6340b-662b-4b7c-9cf0-bb581a99996c"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:55 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:55 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] validate_networks() for [('5eb6340b-662b-4b7c-9cf0-bb581a99996c', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:21:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:21:55 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-031d599e-bbd0-48cb-9715-4cd8c21e6ad9 req-ff914e31-f062-4e4d-bf62-6c0c9ca102db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081825 Apr 18 15:21:55 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:21:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for user ff9093e866924885b8b5cf1893f69b49 and project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:21:56 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bb8574d-66fe-409e-a6e6-9d4b57f7eb0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:21:56 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2a196dab-80f7-4fb5-a646-f7d4471a2e84 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.177325 Apr 18 15:21:56 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 32/97] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:21:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:21:56 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c6bd5ddc-408c-4718-961c-ef06cd937f41 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:56 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c6bd5ddc-408c-4718-961c-ef06cd937f41 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:56 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c6bd5ddc-408c-4718-961c-ef06cd937f41 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:56 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c6bd5ddc-408c-4718-961c-ef06cd937f41 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 200 len: 1252 microversion: 2.1 time: 0.130524 Apr 18 15:21:56 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 33/98] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:56 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 1252 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:57 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9b50e740-d7a4-49b6-adf8-37a784d64f96 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1495 microversion: 2.1 time: 0.469858 Apr 18 15:21:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 34/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:57 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1495 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:21:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:21:58 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:21:58 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-9e4eaf4e-afff-4587-ae53-756e46087a05 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 200 len: 1545 microversion: 2.1 time: 0.692525 Apr 18 15:21:58 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:21:57 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 1545 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 15:22:00 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1976479625", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "6b431f75-004a-45be-9f0d-ec0a00baad53"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:00 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] validate_networks() for [('6b431f75-004a-45be-9f0d-ec0a00baad53', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:22:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:22:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] Creating event network-changed:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:22:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-1185c566-28a6-4ada-8ae5-1d8d7c4eb6e2 req-8dccb9d6-62ae-43b4-be86-76366964767b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049221 Apr 18 15:22:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for user 7c813fea447b4ddd8d0f09078f4f173c and project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:22:01 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:22:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f4cacc8b-ad0b-4736-866f-8df43ea7abe4 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.517819 Apr 18 15:22:01 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 34/102] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:22:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:22:01 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:01 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:01 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:01 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:01 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:01 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-94b7c2c6-4397-4846-9bee-5799da7ca9cf tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 200 len: 1395 microversion: 2.87 time: 0.157658 Apr 18 15:22:01 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:22:01 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:22:02 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bbb6558a-a0b7-47da-bc27-a58e864ad70c tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] Action: 'create', calling method: .version_select at 0x7fc26ae09510>, body: {"keypair": {"name": "tempest-TestShelveInstance-2064987615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfvcHY6dvednbodLfZAl3hEeLNB8zafvThiJBftd8erpZEx5hB9va8VCKxLSK+t1V4L3LXMvM1r3i8iYYktH9cENI1ZPt3OPoGqqXNJg2n1FSHHi/lruWthWgllArvs9A=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:02 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-bbb6558a-a0b7-47da-bc27-a58e864ad70c tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] Getting quotas for project 99716c96d0494f7fb00bf63b54ff4540. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:22:02 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-bbb6558a-a0b7-47da-bc27-a58e864ad70c tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] Getting quotas for user c31e12c24fc44100b4895d7df9aa1c9b and project 99716c96d0494f7fb00bf63b54ff4540. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:22:02 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-bbb6558a-a0b7-47da-bc27-a58e864ad70c tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242830 Apr 18 15:22:02 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:22:02 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "name": "network-vif-plugged", "status": "completed", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] Creating event network-vif-plugged:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:22:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-fddb0a28-b146-4dd6-b04d-d13242d9634c req-79784483-d083-4431-ac43-9f983ce9b0eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041768 Apr 18 15:22:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:05 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:05 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-c2caff63-6442-4511-990a-b936d15ccc24 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 200 len: 1537 microversion: 2.1 time: 0.435198 Apr 18 15:22:05 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:05 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 1537 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "name": "network-vif-plugged", "status": "completed", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}, {"name": "network-changed", "server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:06 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=19 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Creating event network-vif-plugged:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:22:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] Creating event network-changed:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:22:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9074e435-f154-4965-b1af-b6f51ceccff2 req-3cbd9e0f-eefa-41da-8c3e-b1b0bb07f6cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036237 Apr 18 15:22:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 37/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:07 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ea848e98-00a0-451b-9bd3-9202ab868f0b tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] Calling method '.version_select at 0x7fc26ae81fc0>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:07 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=9 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ea848e98-00a0-451b-9bd3-9202ab868f0b tempest-TestShelveInstance-1710448391 tempest-TestShelveInstance-1710448391-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2064987615" status: 202 len: 0 microversion: 2.1 time: 0.031261 Apr 18 15:22:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 18 15:22:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2064987615 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "name": "network-vif-plugged", "status": "completed", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:08 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=25 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:08 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] Creating event network-vif-plugged:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:22:08 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-7fd7a7f4-0eb5-4dda-965a-29779ab06a6c req-bf97e668-4ab4-490b-8fbb-102b995e4f84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097498 Apr 18 15:22:08 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:10 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "name": "network-vif-plugged", "status": "completed", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:10 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:10 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] Creating event network-vif-plugged:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:22:10 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-0efcec94-959d-4e05-b18b-c7979149d8b1 req-81e0c9a5-186c-49c2-926b-84f057c653e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040662 Apr 18 15:22:10 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 38/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:19 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205cbab58b18431da5cded85339cdf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46068c4f77148359db56e2a79acb5d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f10043ec-2ad8-4b75-a4e2-b3b6f9ecfeb5 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f" status: 200 len: 1486 microversion: 2.1 time: 0.331301 Apr 18 15:22:19 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:19 2023] GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f => generated 1486 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=12 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:27 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce463e5c38a846fd82b0829eaa51831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd5f52f6ac845babf10dec78710ad3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:27 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-b3a87063-ef39-44c3-b833-2cf6f6266ede tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 200 len: 1547 microversion: 2.1 time: 0.298523 Apr 18 15:22:27 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:26 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 1547 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ca9c439f-7814-426e-98c1-2ef4d1e1691d tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Action: 'create', calling method: .version_select at 0x7fc26ae0a8c0>, body: {"keypair": {"name": "tempest-keypair-419444609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrIwEfJHTt0AvmohAZBxTLL1lSZIt2e/D2+6dZE6JYkBXbD81uE/b/xXxlD827JzBZKrLOkF6e10EbEjOkgrXLegNk/j6QzhnH3CSqwO9H1W6XUD7IWNnpP7jnfCcDi+w=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-ca9c439f-7814-426e-98c1-2ef4d1e1691d tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Getting quotas for project 7fbe55073a1046539025c5b8f35c456a. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:22:33 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-ca9c439f-7814-426e-98c1-2ef4d1e1691d tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Getting quotas for user 0641255c4ab044a69d49dea48cb09f9d and project 7fbe55073a1046539025c5b8f35c456a. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:22:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ca9c439f-7814-426e-98c1-2ef4d1e1691d tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.453380 Apr 18 15:22:33 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 39/113] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:22:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:34 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:34 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c9429246-60f6-4119-a9c0-4e95f120ea57 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd" status: 200 len: 1545 microversion: 2.1 time: 0.219896 Apr 18 15:22:34 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:34 2023] GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd => generated 1545 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1672950935", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "c4629e52-8315-423c-8091-4375ff05586e"}], "security_groups": [{"name": "tempest-securitygroup--319437347"}], "key_name": "tempest-keypair-419444609", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] validate_networks() for [('c4629e52-8315-423c-8091-4375ff05586e', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Getting quotas for project 7fbe55073a1046539025c5b8f35c456a. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Getting quotas for user 0641255c4ab044a69d49dea48cb09f9d and project 7fbe55073a1046539025c5b8f35c456a. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:22:35 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:22:35 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2302ade5-036d-49d1-aa87-b899ea3850b2 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.628644 Apr 18 15:22:35 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:22:35 2023] POST /compute/v2.1/servers => generated 403 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:22:35 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-7afd49e4-a987-41f9-8698-da096e959378 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7afd49e4-a987-41f9-8698-da096e959378 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:35 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7afd49e4-a987-41f9-8698-da096e959378 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0641255c4ab044a69d49dea48cb09f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe55073a1046539025c5b8f35c456a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:35 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-7afd49e4-a987-41f9-8698-da096e959378 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 200 len: 1239 microversion: 2.1 time: 0.063858 Apr 18 15:22:35 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:35 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] Creating event network-changed:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:22:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-56582e33-0a03-478b-8ba5-be9da2303f16 req-459ad01b-69a3-430e-bb4d-b0f2d042eda4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035663 Apr 18 15:22:38 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "name": "network-vif-plugged", "status": "completed", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] Creating event network-vif-plugged:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:22:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-3fa3b008-ef5b-4c55-ace5-a5fc06352a16 req-c9790f10-679d-4b05-b4fc-fc9c1badf18c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 Apr 18 15:22:40 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:42 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "name": "network-vif-plugged", "status": "completed", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] Creating event network-vif-plugged:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:22:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d8b49b5d-cdc4-40e7-aee7-60a0fce67842 req-b52ab296-7f8c-46ec-9fe3-ae2b62789c64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Apr 18 15:22:42 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:46 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:46 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-1c8ffa26-ab32-4ad8-9aab-f31673229ed7 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 200 len: 1536 microversion: 2.1 time: 0.312616 Apr 18 15:22:46 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:46 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 1536 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=10 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:52 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:52 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:52 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:52 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-268afea1-3f45-4e71-a657-13a08dba51c5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 200 len: 1691 microversion: 2.87 time: 0.345708 Apr 18 15:22:52 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 40/121] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:22:51 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 1691 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:22:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9b669a31-e440-4c87-af76-91f7f5550f6f tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28" status: 204 len: 0 microversion: 2.1 time: 0.173291 Apr 18 15:22:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:22:54 2023] DELETE /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:54 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:55 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35c59aa3ad6e42f2989f045fbe926d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c48b75a2d654c548352e0e9d5552742', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:55 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "name": "network-vif-unplugged", "status": "completed", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-3e27e7ae-4a64-47b6-8608-059efd37b2db tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28" status: 200 len: 1495 microversion: 2.1 time: 0.273783 Apr 18 15:22:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:54 2023] GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 => generated 1495 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:55 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] Creating event network-vif-unplugged:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:22:55 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-041cf42a-e87c-4c5d-8034-09570c52a037 req-d2b6d5ab-6054-43bb-a7ff-5b9a535d8ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034626 Apr 18 15:22:55 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "name": "network-vif-plugged", "status": "completed", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}, {"server_uuid": "cf6ff210-bb47-40c3-8139-7f2a821abc28", "name": "network-vif-deleted", "tag": "9ac87496-bd58-45dc-a7aa-2b95cdb9949c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Creating event network-vif-plugged:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:22:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] Creating event network-vif-deleted:9ac87496-bd58-45dc-a7aa-2b95cdb9949c for instance cf6ff210-bb47-40c3-8139-7f2a821abc28 on user Apr 18 15:22:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-51c62934-49b1-41ef-8e7c-3d6b0e60bc8f req-443dff32-caef-4257-b046-e997edf316fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029913 Apr 18 15:22:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 43/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:22:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:22:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1987381881", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "43382397-0fa6-439e-8b5e-88a4313fb3de"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:22:57 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] validate_networks() for [('43382397-0fa6-439e-8b5e-88a4313fb3de', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Getting quotas for project ebf08f40b0da4ad7b2b8fdb2834d464b. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Getting quotas for user 99cb7e246c95430e8324dfa9ee5dd10f and project ebf08f40b0da4ad7b2b8fdb2834d464b. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:22:58 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:22:58 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-b5253273-3b20-49d8-acc6-b01422bdd087 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.556154 Apr 18 15:22:58 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 42/126] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:22:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:22:58 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d195d7ab-d348-46eb-957d-9223715fe343 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:58 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-d195d7ab-d348-46eb-957d-9223715fe343 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:58 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-d195d7ab-d348-46eb-957d-9223715fe343 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:22:58 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d195d7ab-d348-46eb-957d-9223715fe343 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 200 len: 1211 microversion: 2.1 time: 0.067693 Apr 18 15:22:58 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:22:58 2023] GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 1211 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:22:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:22:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-33840606-afe2-4517-b3ff-2f13b669cb44 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.386177 Apr 18 15:22:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:22:58 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1/os-interface => generated 282 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:00 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:00 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] Creating event network-changed:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:23:00 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c0e4ad13-4072-4a75-beee-3498377a96bf req-02ec4554-dad2-43ec-ab2e-6416f5bc93cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031433 Apr 18 15:23:00 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:00 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:00 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-c911696f-6f25-4049-b859-af00d53d5bb8 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1/ips" status: 200 len: 107 microversion: 2.1 time: 0.420419 Apr 18 15:23:00 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:23:00 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1/ips => generated 107 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:01 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] Creating event network-changed:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:23:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-f4f641d9-6344-4053-b3ac-c50f78884a4a req-bcf6248b-545b-4bed-ac2d-1ce470f15870 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Apr 18 15:23:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:02 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:23:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-293b4e8b-8a52-4b4d-8237-a67ffb5c2df2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 204 len: 0 microversion: 2.1 time: 0.159929 Apr 18 15:23:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 44/132] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:23:02 2023] DELETE /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:02 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:02 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-99617a55-47dd-4f53-808b-5c1e3fb2eb74 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 200 len: 1669 microversion: 2.1 time: 0.358374 Apr 18 15:23:02 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:02 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 1669 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "name": "network-vif-unplugged", "status": "completed", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}, {"server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "name": "network-vif-plugged", "status": "completed", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Creating event network-vif-unplugged:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:23:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] Creating event network-vif-plugged:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:23:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-28576fb9-6e7f-40f2-9239-4342770cb1a0 req-c0d53e73-5a10-4125-ac34-81c288551ad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030902 Apr 18 15:23:03 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "name": "network-vif-plugged", "status": "completed", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}, {"server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "name": "network-vif-plugged", "status": "completed", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}, {"server_uuid": "fcc0516f-559a-4d0c-aeab-56d2c08882a1", "name": "network-vif-deleted", "tag": "d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:05 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Creating event network-vif-plugged:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:23:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Creating event network-vif-plugged:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:23:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] Creating event network-vif-deleted:d83591fe-d401-4d8c-9c9a-d7dd66dcfdfa for instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 on user Apr 18 15:23:05 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-1a4077fe-a29d-424f-9216-24ff2bd1a565 req-0692b518-5eba-4213-b927-4d0c046ddf5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040917 Apr 18 15:23:05 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:05 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:05 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:06 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-94848192-5249-46ac-8fab-77849999a6b8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.234921 Apr 18 15:23:06 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:23:05 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902/os-interface => generated 282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:07 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:07 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] Creating event network-changed:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:23:07 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-685fe9b6-f486-44c8-92ba-b0ef65f6c205 req-24f53fea-aeca-41d6-934b-a3a087c5ee57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041317 Apr 18 15:23:07 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:07 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:07 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-399dbf7a-6c69-446d-ab35-90a2dc76f2e4 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902/ips" status: 200 len: 104 microversion: 2.1 time: 0.237650 Apr 18 15:23:07 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:23:07 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902/ips => generated 104 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:09 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:23:09 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2a3a4d59-a30f-45de-aa51-b37ab96f9099 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 204 len: 0 microversion: 2.1 time: 0.146605 Apr 18 15:23:09 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:23:09 2023] DELETE /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:09 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3e9ee789-1469-4480-ab17-aec2f387c7c7 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 200 len: 1661 microversion: 2.1 time: 0.324383 Apr 18 15:23:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:09 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 1661 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "name": "network-vif-unplugged", "status": "completed", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:09 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:09 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] Creating event network-vif-unplugged:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:23:09 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-b95a8eb4-050a-4f75-9cfd-959f7abb6dad req-e066716e-7cea-423f-9550-17f9d98b9a6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031716 Apr 18 15:23:09 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:11 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "name": "network-vif-plugged", "status": "completed", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}, {"server_uuid": "f420f72a-75b8-4492-936b-652048e06902", "name": "network-vif-deleted", "tag": "8d166e3d-3bd1-49ae-a8b7-2197bf07cb51"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:11 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:11 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:11 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:12 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Creating event network-vif-plugged:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:23:12 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] Creating event network-vif-deleted:8d166e3d-3bd1-49ae-a8b7-2197bf07cb51 for instance f420f72a-75b8-4492-936b-652048e06902 on user Apr 18 15:23:12 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-a49dc85c-6221-4f93-b341-d5b319c502ab req-0a17998f-0db2-4e2c-bce0-28a8790eb189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032551 Apr 18 15:23:12 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:23:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-8de0ee62-d496-4fcf-880d-7b662274f6f3 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f" status: 204 len: 0 microversion: 2.1 time: 0.131586 Apr 18 15:23:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:23:21 2023] DELETE /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=5 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=7 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-unplugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:21 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205cbab58b18431da5cded85339cdf51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46068c4f77148359db56e2a79acb5d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-23455384-826f-4d72-ad31-21de593309cc tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f" status: 200 len: 1492 microversion: 2.1 time: 0.277386 Apr 18 15:23:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:21 2023] GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f => generated 1492 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] Creating event network-vif-unplugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-a5203389-08bb-49a2-9662-cde37485aae2 req-450c0a5e-19cd-45ce-bb34-dee674a6714c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048122 Apr 18 15:23:21 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-deleted", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] Creating event network-vif-deleted:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-b6ac4d78-bfe5-43d7-9a1e-c96736c7abaa req-6697aeea-2fcd-4ad4-87b9-86136dc7f6ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Apr 18 15:23:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:23 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}, {"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}, {"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}, {"server_uuid": "e2d13c96-a763-46c1-b214-80f34151543f", "name": "network-vif-plugged", "status": "completed", "tag": "c052d23c-4da9-45ff-b091-49b333016b1e"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] Creating event network-vif-plugged:c052d23c-4da9-45ff-b091-49b333016b1e for instance e2d13c96-a763-46c1-b214-80f34151543f on user Apr 18 15:23:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-51019a2c-19cc-4e4b-b927-2183624765bc req-37dcfe06-242e-4480-8afd-a3e1879179cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031455 Apr 18 15:23:23 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:26 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0641255c4ab044a69d49dea48cb09f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe55073a1046539025c5b8f35c456a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:26 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2ab686a2-7ce5-499f-b155-71f3b88c2557 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 200 len: 1553 microversion: 2.1 time: 0.232286 Apr 18 15:23:26 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:25 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:27 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a867aff5-3f5f-488e-9030-f8fb4e01f974 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.158944 Apr 18 15:23:27 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:23:27 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4/os-interface => generated 283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] Creating event network-changed:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:23:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-db23aa13-a0b8-4fae-89d9-c7cdfa2d2b54 req-5f06c20a-4e62-4a26-9793-1640fe952f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032064 Apr 18 15:23:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:29 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:23:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2393f70f-d09d-429a-866d-20af92cdc8bf tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 204 len: 0 microversion: 2.1 time: 0.114026 Apr 18 15:23:29 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:23:29 2023] DELETE /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:29 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce463e5c38a846fd82b0829eaa51831a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dd5f52f6ac845babf10dec78710ad3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0ca6386e-899d-42b9-9b92-e0f0e2b7d241 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 200 len: 1672 microversion: 2.1 time: 0.195980 Apr 18 15:23:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:29 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:30 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "name": "network-vif-unplugged", "status": "completed", "tag": "90967987-e536-45f4-8e45-7e0808853516"}, {"server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "name": "network-vif-plugged", "status": "completed", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Creating event network-vif-unplugged:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:23:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] Creating event network-vif-plugged:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:23:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c531a113-392c-4647-9391-d13eb34d94b0 req-f5ee35d1-7b14-488f-ace0-658cd9b82e25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028496 Apr 18 15:23:30 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 51/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:32 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a60c305-73e0-4a37-8e43-c1cb54eed2d4", "name": "network-vif-deleted", "tag": "90967987-e536-45f4-8e45-7e0808853516"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:32 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] Creating event network-vif-deleted:90967987-e536-45f4-8e45-7e0808853516 for instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 on user Apr 18 15:23:32 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-0da4880f-aecf-4293-8ff5-e48edec9ad1c req-ee847ae1-2d8a-424d-bc81-917788539afc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 Apr 18 15:23:32 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:34 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:34 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-28af497e-7bbc-48c5-9580-53767b99b461 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.170731 Apr 18 15:23:34 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:23:34 2023] GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd/os-interface => generated 283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:35 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:35 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] Creating event network-changed:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:23:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-e9169057-5620-44ef-a60c-128da1181621 req-8a282c82-1b38-4757-bbbe-009aa9964652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030286 Apr 18 15:23:35 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1689780935", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "70f00798-af6a-4eb7-b15c-89b7a38f573e"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] validate_networks() for [('70f00798-af6a-4eb7-b15c-89b7a38f573e', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Getting quotas for user fb1187e621234a18a337d8bae5c59ec3 and project 8c34ff3309c74223b4c2e3e7f6698860. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:23:37 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:23:37 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e4622308-19f9-49e7-b7d5-498e9b446494 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.623276 Apr 18 15:23:37 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 52/157] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:23:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:23:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-aa267a72-558f-45ae-8bb8-ff32b23bf47e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:37 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-aa267a72-558f-45ae-8bb8-ff32b23bf47e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:37 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-aa267a72-558f-45ae-8bb8-ff32b23bf47e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-aa267a72-558f-45ae-8bb8-ff32b23bf47e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f" status: 200 len: 1212 microversion: 2.1 time: 0.059722 Apr 18 15:23:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 54/158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:37 2023] GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f => generated 1212 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] Creating event network-changed:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:23:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-be137ab9-ddb1-469d-a6bb-8c5fb5cdc6f6 req-b3ef95a0-0c79-4514-a21b-6728aceba29f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029363 Apr 18 15:23:40 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:42 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "name": "network-vif-plugged", "status": "completed", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] Creating event network-vif-plugged:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:23:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-fc518e88-79ca-421d-a188-1bede6a8f499 req-3ebc89a6-db73-4ce5-8faa-e33d26e4bdbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038450 Apr 18 15:23:42 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "name": "network-vif-plugged", "status": "completed", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] Creating event network-vif-plugged:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:23:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-081ec115-0c15-4211-95c7-dd0b5e238c46 req-7d4bc670-8105-4d6b-983e-bc0929ceee8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 Apr 18 15:23:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] [instance: cf6ff210-bb47-40c3-8139-7f2a821abc28] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] HTTP exception thrown: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Request method failure captured: Apr 18 15:23:45 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 HTTP/1.1 Apr 18 15:23:45 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:23:45 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:23:45 user devstack@n-api.service[61366]: Connection: close Apr 18 15:23:45 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:23:45 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:23:45 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:23:45 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:23:45 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVaRSl4NDn0NjtlqHYe623RVWcApYYWyaxhIqfeHnAbX3ZwaJlrh14ufbeE30ABVP4_yEzW6PdbOz42jEixyc-ApMBmW4kRHehUjPAVDH4y88u9vOzFOfI7RJHTlASsTA7MX5eAQVa4yssWRCt2-qzaYifr4eZpN7QHTG3UU-DnYzw Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Project-Id: 5c48b75a2d654c548352e0e9d5552742 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Project-Name: tempest-DeleteServersTestJSON-1810458559 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c48b75a2d654c548352e0e9d5552742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c48b75a2d654c548352e0e9d5552742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c48b75a2d654c548352e0e9d5552742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Tenant: tempest-DeleteServersTestJSON-1810458559 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Tenant-Id: 5c48b75a2d654c548352e0e9d5552742 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1810458559 Apr 18 15:23:45 user devstack@n-api.service[61366]: X-User: tempest-DeleteServersTestJSON-1810458559-project-member Apr 18 15:23:45 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:23:45 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:23:45 user devstack@n-api.service[61366]: X-User-Id: 35c59aa3ad6e42f2989f045fbe926d9d Apr 18 15:23:45 user devstack@n-api.service[61366]: X-User-Name: tempest-DeleteServersTestJSON-1810458559-project-member Apr 18 15:23:45 user devstack@n-api.service[61366]: method: > Apr 18 15:23:45 user devstack@n-api.service[61366]: exception: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. Apr 18 15:23:45 user devstack@n-api.service[61366]: action_args: {'id': 'cf6ff210-bb47-40c3-8139-7f2a821abc28'} Apr 18 15:23:45 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. Apr 18 15:23:45 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:23:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] Returning 404 to user: Instance cf6ff210-bb47-40c3-8139-7f2a821abc28 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:23:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-9916adbe-628a-46b0-8da0-8918e2608233 tempest-DeleteServersTestJSON-1810458559 tempest-DeleteServersTestJSON-1810458559-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28" status: 404 len: 111 microversion: 2.1 time: 0.041795 Apr 18 15:23:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:45 2023] GET /compute/v2.1/servers/cf6ff210-bb47-40c3-8139-7f2a821abc28 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-0cd59afc-c397-48ae-8fb8-12d64036800d tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 200 len: 1536 microversion: 2.1 time: 0.306612 Apr 18 15:23:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:47 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 1536 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Searching by: {'deleted': False, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d'} {{(pid=61365) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61365]: DEBUG nova.compute.multi_cell_list [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61365) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 15:23:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3a71cb9a-e14f-4482-be73-b3a305fb777e tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.205573 Apr 18 15:23:47 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 15:23:47 2023] GET /compute/v2.1/servers => generated 341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:47 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:47 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8f256130-1439-4086-855f-a960087ee28a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 200 len: 1536 microversion: 2.1 time: 0.228276 Apr 18 15:23:47 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 55/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:47 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 1536 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:48 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:48 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d7f4cd70-c502-4cee-a2cb-12737e7fe459 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 200 len: 1494 microversion: 2.1 time: 0.265365 Apr 18 15:23:48 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:48 2023] GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:23:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a25b18c1-d0f2-43c8-a787-d8edffb6dfff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 204 len: 0 microversion: 2.1 time: 0.132409 Apr 18 15:23:49 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:23:49 2023] DELETE /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-60bee252-4dd3-4deb-a94a-fdbc1637825c tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 200 len: 1542 microversion: 2.1 time: 0.169396 Apr 18 15:23:49 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:49 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 1542 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "name": "network-vif-unplugged", "status": "completed", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] Creating event network-vif-unplugged:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:23:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-5ccc98a9-c6ed-4cbe-8594-1448026bcfe1 req-2506bc05-d7ab-47ef-a927-551cff1642eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042264 Apr 18 15:23:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "name": "network-vif-plugged", "status": "completed", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}, {"server_uuid": "03c7e520-78d4-489c-81aa-c9a6d27b2b62", "name": "network-vif-deleted", "tag": "980dc469-6eaa-4544-8709-2cb34fe17f51"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:51 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Creating event network-vif-plugged:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:23:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] Creating event network-vif-deleted:980dc469-6eaa-4544-8709-2cb34fe17f51 for instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 on user Apr 18 15:23:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-80a52e38-b1e6-4154-ae41-110f6ea7d2bc req-2f939dd4-109a-4ee6-b75c-5ef7ef3b310c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031911 Apr 18 15:23:51 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-701990222"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=19 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:52 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=31 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:52 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:23:52 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 HTTP/1.1 Apr 18 15:23:52 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:23:52 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:23:52 user devstack@n-api.service[61367]: Connection: close Apr 18 15:23:52 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:23:52 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:23:52 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:23:52 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:23:52 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:23:52 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:23:52 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:23:52 user devstack@n-api.service[61367]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:23:52 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:23:52 user devstack@n-api.service[61367]: method: > Apr 18 15:23:52 user devstack@n-api.service[61367]: exception: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:23:52 user devstack@n-api.service[61367]: action_args: {'id': 'fcc0516f-559a-4d0c-aeab-56d2c08882a1'} Apr 18 15:23:52 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:23:52 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:23:52 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:23:52 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-781a4435-d2f7-4e1f-9487-1acb07fc793f tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 404 len: 111 microversion: 2.1 time: 0.060745 Apr 18 15:23:52 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:52 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:23:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-2091d6d4-15a5-4b65-84dc-947fb9c6ff6c tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '.version_select at 0x7fc26adca560>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2091d6d4-15a5-4b65-84dc-947fb9c6ff6c tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496363600" status: 202 len: 0 microversion: 2.1 time: 0.026613 Apr 18 15:23:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:23:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496363600 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:23:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-3c835870-afd2-4648-94c4-998e0ba66238 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37/action" status: 202 len: 52 microversion: 2.87 time: 0.860569 Apr 18 15:23:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 57/173] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 15:23:52 2023] POST /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37/action => generated 52 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 15:23:53 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d1e2611a-4634-4cec-bc43-a300cab46686 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: .version_select at 0x7fc26acd88b0>, body: {"keypair": {"name": "tempest-keypair-1759299414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkEQhNv/UT/OfiGU5/5OIYC4t7RHeodUWzU5uty1pZrf4ZWIsbVmr5oMEGKF099otAd4aO4dhwDN9dvbDuvZB7Pp/HsDLAFKFZ34F0yTq1jxJm09YJR1YCjWiEF2EBdQQ=="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:53 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-d1e2611a-4634-4cec-bc43-a300cab46686 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:23:53 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-d1e2611a-4634-4cec-bc43-a300cab46686 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:23:53 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d1e2611a-4634-4cec-bc43-a300cab46686 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049779 Apr 18 15:23:53 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 58/174] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:23:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:55 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442829303", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "03193d32-3e21-4e7c-ae10-c5ddd6544407"}], "security_groups": [{"name": "tempest-securitygroup--1325301424"}], "key_name": "tempest-keypair-1759299414", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:55 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] validate_networks() for [('03193d32-3e21-4e7c-ae10-c5ddd6544407', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:23:56 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:23:56 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dd10dfb9-d803-462f-9fab-6ef0bb4628e0 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.385116 Apr 18 15:23:56 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 60/175] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:23:55 2023] POST /compute/v2.1/servers => generated 400 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:23:56 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-884e9483-756c-43a6-9305-5efd077bc46a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:56 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-884e9483-756c-43a6-9305-5efd077bc46a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:56 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:57 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-884e9483-756c-43a6-9305-5efd077bc46a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:57 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-884e9483-756c-43a6-9305-5efd077bc46a tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 200 len: 1235 microversion: 2.1 time: 0.079736 Apr 18 15:23:57 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:56 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 1235 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8986a5dd-f16c-4588-873e-3f87c4f2d1b6 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Action: 'create', calling method: .version_select at 0x7fc26b807640>, body: {"keypair": {"name": "tempest-keypair-1780748071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKciQFPz2DPc6e222MTe8Iis16y5nDMsvMOnpJC271XwMop7o1hYlxWwUspjxyKQ2Qktv4QhACRnUT/C9zQCv3r9Ngog7/mtWnfyG2QnbFvQTPqXPPXdHur3yO23jpl5Xw=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:57 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8986a5dd-f16c-4588-873e-3f87c4f2d1b6 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Getting quotas for project 5a93c03c2c6c485fadd7209380ee7e3b. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:23:57 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-8986a5dd-f16c-4588-873e-3f87c4f2d1b6 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Getting quotas for user c0cdce8a340441bf8777dbc42f2118ca and project 5a93c03c2c6c485fadd7209380ee7e3b. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:23:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8986a5dd-f16c-4588-873e-3f87c4f2d1b6 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218391 Apr 18 15:23:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 58/177] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:23:56 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:58 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:58 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-7221b92f-dd2b-46f4-9d84-b341b66751c2 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 200 len: 1704 microversion: 2.87 time: 0.343057 Apr 18 15:23:58 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 61/178] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:23:58 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 1704 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:23:58 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1496768709", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4caf5710-7663-43d4-91f0-14163c6d0ff2"}], "security_groups": [{"name": "tempest-securitygroup--1852273947"}], "key_name": "tempest-keypair-1780748071", "user_data": "}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:58 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] validate_networks() for [('4caf5710-7663-43d4-91f0-14163c6d0ff2', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Getting quotas for project 5a93c03c2c6c485fadd7209380ee7e3b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Getting quotas for user c0cdce8a340441bf8777dbc42f2118ca and project 5a93c03c2c6c485fadd7209380ee7e3b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:23:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-ceb530b2-e439-4d0b-a255-64735f53995f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.683876 Apr 18 15:23:59 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:23:58 2023] POST /compute/v2.1/servers => generated 407 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:23:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6ca2b2ff-4a55-4e80-bc10-3eaba4823871 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:59 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6ca2b2ff-4a55-4e80-bc10-3eaba4823871 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6ca2b2ff-4a55-4e80-bc10-3eaba4823871 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:23:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6ca2b2ff-4a55-4e80-bc10-3eaba4823871 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1233 microversion: 2.1 time: 0.067721 Apr 18 15:23:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 59/180] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:59 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1233 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:23:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:23:59 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 HTTP/1.1 Apr 18 15:23:59 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:23:59 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:23:59 user devstack@n-api.service[61365]: Connection: close Apr 18 15:23:59 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:23:59 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:23:59 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:23:59 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:23:59 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:23:59 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:23:59 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:23:59 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:23:59 user devstack@n-api.service[61365]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:23:59 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:23:59 user devstack@n-api.service[61365]: method: > Apr 18 15:23:59 user devstack@n-api.service[61365]: exception: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:23:59 user devstack@n-api.service[61365]: action_args: {'id': 'f420f72a-75b8-4492-936b-652048e06902'} Apr 18 15:23:59 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:23:59 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:23:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b4a1e698-8b21-4729-8ac0-9a39d98a2d64 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 404 len: 111 microversion: 2.1 time: 0.044130 Apr 18 15:24:00 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 62/181] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:23:59 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:24:00 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] Creating event network-changed:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:24:00 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-239750ce-dbc0-4280-8b6a-8575764063d5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '.version_select at 0x7fc26acc5090>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:00 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-738f4e06-256d-4d76-9915-42cb130c2904 req-b90a958f-5ef9-4a2b-b9b2-fb7120f32801 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055202 Apr 18 15:24:00 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:00 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-239750ce-dbc0-4280-8b6a-8575764063d5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117243910" status: 202 len: 0 microversion: 2.1 time: 0.028610 Apr 18 15:24:00 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 60/183] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:23:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117243910 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:24:01 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b38a298f-4bf6-4c55-83c4-a5135f6667c8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Action: 'create', calling method: .version_select at 0x7fc26aa3d240>, body: {"keypair": {"name": "tempest-keypair-1071032263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0+z1T8JGAqOwEd47wtk+oiuve8oER6pPhgz5GXldqvtEyzaNUi+YhHCo3rDf8zNGGpB0LFt3coxqAMz8raHCcmBslKDY19GMdgDIKKUxC8Esh6nPvPxbLRWsbpIoXGlA=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b38a298f-4bf6-4c55-83c4-a5135f6667c8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for project 7269241b8f244a86b51580dd6319d5c6. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:24:01 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-b38a298f-4bf6-4c55-83c4-a5135f6667c8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for user c133acd96c98486fac2085187824d10b and project 7269241b8f244a86b51580dd6319d5c6. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:24:01 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b38a298f-4bf6-4c55-83c4-a5135f6667c8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045435 Apr 18 15:24:01 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 63/184] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:24:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:02 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "name": "network-vif-plugged", "status": "completed", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:02 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:02 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] Creating event network-vif-plugged:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:24:02 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-6c09a61e-b515-45d1-957b-c69696aadd23 req-deb2bb4f-8070-498a-b19c-004296230975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038282 Apr 18 15:24:02 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:02 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:02 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] Creating event network-changed:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:24:02 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-33256a9f-21fa-4fe3-9c27-bf338ef97d37 req-0d5f667d-7e34-439b-a425-58820c0d992b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034765 Apr 18 15:24:02 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 61/186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-69839217", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "5fec6c8b-49b1-4298-a7ee-886f04baa0e2"}], "security_groups": [{"name": "tempest-securitygroup--453764631"}], "key_name": "tempest-keypair-1071032263", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] validate_networks() for [('5fec6c8b-49b1-4298-a7ee-886f04baa0e2', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for project 7269241b8f244a86b51580dd6319d5c6. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Getting quotas for user c133acd96c98486fac2085187824d10b and project 7269241b8f244a86b51580dd6319d5c6. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:24:03 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:24:03 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-e94d4a8c-b075-441e-85c7-d4611f13cb04 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.633893 Apr 18 15:24:03 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 64/187] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:24:03 2023] POST /compute/v2.1/servers => generated 399 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 15:24:03 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-600c487f-2527-4abd-aea1-7bd4005eaffa tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:03 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-600c487f-2527-4abd-aea1-7bd4005eaffa tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:04 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-600c487f-2527-4abd-aea1-7bd4005eaffa tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:04 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-600c487f-2527-4abd-aea1-7bd4005eaffa tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 200 len: 1230 microversion: 2.1 time: 0.115265 Apr 18 15:24:04 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:03 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 1230 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 15:24:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "name": "network-vif-plugged", "status": "completed", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] Creating event network-vif-plugged:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:24:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-1b834801-5f69-4dd2-9a2e-1eaba6f89880 req-e970e2e3-8ac3-469b-8f85-dcda7fc6bbd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055884 Apr 18 15:24:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 62/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:06 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "name": "network-vif-plugged", "status": "completed", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}, {"server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "name": "network-vif-plugged", "status": "completed", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:06 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Creating event network-vif-plugged:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:24:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] Creating event network-vif-plugged:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:24:06 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-0d089e3d-ec85-4623-a661-7bf7f88b668a req-3a2961a7-fefe-4796-8f06-7030c8f52cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034060 Apr 18 15:24:06 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:09 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:09 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:09 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] Creating event network-changed:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:24:09 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-abca1c07-806e-49cb-b441-5187b9533ed7 req-fe4b2baa-8335-4c1d-88fc-b287fd106175 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Apr 18 15:24:09 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 64/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "name": "network-vif-plugged", "status": "completed", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] Creating event network-vif-plugged:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:24:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-9cf16295-66b7-4968-802e-85af61a34b77 req-36d9258f-d166-49b8-96ea-db49546d90d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100710 Apr 18 15:24:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 63/192] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] [instance: e2d13c96-a763-46c1-b214-80f34151543f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] HTTP exception thrown: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Request method failure captured: Apr 18 15:24:11 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f HTTP/1.1 Apr 18 15:24:11 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:24:11 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:24:11 user devstack@n-api.service[61365]: Connection: close Apr 18 15:24:11 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:24:11 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:24:11 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:24:11 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:24:11 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVwIMquFzEGevFyhpcb4wsxVNL7_TBBfO2Evpsd0v1az45-IQUOQ7I1I-semo_kXKGnDdPh0cUtvDQyLGaBHWSTJuXLg5BR6Rnutl_0xkuBOB7hPKx8e4hSguNQcd0Adqq1bU9SEhiEePkxK6YXVy7nnYJdf6SZTYSADbfatpPQ3_o Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Project-Id: c46068c4f77148359db56e2a79acb5d6 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Project-Name: tempest-VolumesActionsTest-748322637 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c46068c4f77148359db56e2a79acb5d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c46068c4f77148359db56e2a79acb5d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c46068c4f77148359db56e2a79acb5d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Tenant: tempest-VolumesActionsTest-748322637 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Tenant-Id: c46068c4f77148359db56e2a79acb5d6 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-VolumesActionsTest-748322637 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-User: tempest-VolumesActionsTest-748322637-project-member Apr 18 15:24:11 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:24:11 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:24:11 user devstack@n-api.service[61365]: X-User-Id: 205cbab58b18431da5cded85339cdf51 Apr 18 15:24:11 user devstack@n-api.service[61365]: X-User-Name: tempest-VolumesActionsTest-748322637-project-member Apr 18 15:24:11 user devstack@n-api.service[61365]: method: > Apr 18 15:24:11 user devstack@n-api.service[61365]: exception: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. Apr 18 15:24:11 user devstack@n-api.service[61365]: action_args: {'id': 'e2d13c96-a763-46c1-b214-80f34151543f'} Apr 18 15:24:11 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. Apr 18 15:24:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:24:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] Returning 404 to user: Instance e2d13c96-a763-46c1-b214-80f34151543f could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1c5792f8-5f48-48d8-9467-cb73061df604 tempest-VolumesActionsTest-748322637 tempest-VolumesActionsTest-748322637-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f" status: 404 len: 111 microversion: 2.1 time: 0.029297 Apr 18 15:24:11 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:11 2023] GET /compute/v2.1/servers/e2d13c96-a763-46c1-b214-80f34151543f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 18 15:24:13 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:13 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "name": "network-vif-plugged", "status": "completed", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:13 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:13 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:13 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:13 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] Creating event network-vif-plugged:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:24:13 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-bb5161a7-d37b-4f8c-9c0a-5d3770512808 req-653aae6c-aaf2-4736-8508-cf829b1c519d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036548 Apr 18 15:24:13 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 65/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] HTTP exception thrown: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Request method failure captured: Apr 18 15:24:19 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 HTTP/1.1 Apr 18 15:24:19 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:24:19 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:24:19 user devstack@n-api.service[61366]: Connection: close Apr 18 15:24:19 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:24:19 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:24:19 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:24:19 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:24:19 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVf924xHxPPW6rXG5BeWFO-ocXLMxx54ZunFxoENdamm08BYYM1loRnOOjJerntT3V7zHxVXQMKiZMzVW8beLhyNSHMBXeU_rEzbPKg8nEe48FibN2HHe61pq5uU4jizYlDVcCQnLnPaQ-cbN2ss5wnUICYJjARatHiWBH_z7_4_H0 Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Project-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Tenant-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:19 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:19 user devstack@n-api.service[61366]: X-User: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:19 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:24:19 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:24:19 user devstack@n-api.service[61366]: X-User-Id: ce463e5c38a846fd82b0829eaa51831a Apr 18 15:24:19 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:19 user devstack@n-api.service[61366]: method: > Apr 18 15:24:19 user devstack@n-api.service[61366]: exception: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:19 user devstack@n-api.service[61366]: action_args: {'id': '8a60c305-73e0-4a37-8e43-c1cb54eed2d4'} Apr 18 15:24:19 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Returning 404 to user: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-589e1bd2-2a48-4069-bfd2-a5cb483d9f5e tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 404 len: 111 microversion: 2.1 time: 0.030391 Apr 18 15:24:19 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 64/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:19 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:24:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-30cef366-4464-4826-a1d0-c3d5b1eb061a tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '.version_select at 0x7fc26aa3e200>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=16 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-30cef366-4464-4826-a1d0-c3d5b1eb061a tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66129059" status: 202 len: 0 microversion: 2.1 time: 0.025518 Apr 18 15:24:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 15:24:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66129059 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=14 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] HTTP exception thrown: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Request method failure captured: Apr 18 15:24:21 user devstack@n-api.service[61367]: request: DELETE /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 HTTP/1.1 Apr 18 15:24:21 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:24:21 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:24:21 user devstack@n-api.service[61367]: Connection: close Apr 18 15:24:21 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:24:21 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:24:21 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:24:21 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:24:21 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVf924xHxPPW6rXG5BeWFO-ocXLMxx54ZunFxoENdamm08BYYM1loRnOOjJerntT3V7zHxVXQMKiZMzVW8beLhyNSHMBXeU_rEzbPKg8nEe48FibN2HHe61pq5uU4jizYlDVcCQnLnPaQ-cbN2ss5wnUICYJjARatHiWBH_z7_4_H0 Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Project-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Tenant-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:21 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61367]: X-User: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:21 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:24:21 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:24:21 user devstack@n-api.service[61367]: X-User-Id: ce463e5c38a846fd82b0829eaa51831a Apr 18 15:24:21 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:21 user devstack@n-api.service[61367]: method: > Apr 18 15:24:21 user devstack@n-api.service[61367]: exception: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61367]: action_args: {'id': '8a60c305-73e0-4a37-8e43-c1cb54eed2d4'} Apr 18 15:24:21 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Returning 404 to user: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e1d7aead-f6bf-451c-a784-b6cce1cd5835 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 404 len: 111 microversion: 2.1 time: 0.047649 Apr 18 15:24:21 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 66/197] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:24:21 2023] DELETE /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] [instance: 8a60c305-73e0-4a37-8e43-c1cb54eed2d4] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] HTTP exception thrown: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Request method failure captured: Apr 18 15:24:21 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 HTTP/1.1 Apr 18 15:24:21 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:24:21 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:24:21 user devstack@n-api.service[61366]: Connection: close Apr 18 15:24:21 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:24:21 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:24:21 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:24:21 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:24:21 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVf924xHxPPW6rXG5BeWFO-ocXLMxx54ZunFxoENdamm08BYYM1loRnOOjJerntT3V7zHxVXQMKiZMzVW8beLhyNSHMBXeU_rEzbPKg8nEe48FibN2HHe61pq5uU4jizYlDVcCQnLnPaQ-cbN2ss5wnUICYJjARatHiWBH_z7_4_H0 Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Project-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6dd5f52f6ac845babf10dec78710ad3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Tenant-Id: 6dd5f52f6ac845babf10dec78710ad3c Apr 18 15:24:21 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-648475788 Apr 18 15:24:21 user devstack@n-api.service[61366]: X-User: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:21 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:24:21 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:24:21 user devstack@n-api.service[61366]: X-User-Id: ce463e5c38a846fd82b0829eaa51831a Apr 18 15:24:21 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-648475788-project-member Apr 18 15:24:21 user devstack@n-api.service[61366]: method: > Apr 18 15:24:21 user devstack@n-api.service[61366]: exception: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61366]: action_args: {'id': '8a60c305-73e0-4a37-8e43-c1cb54eed2d4'} Apr 18 15:24:21 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. Apr 18 15:24:21 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] Returning 404 to user: Instance 8a60c305-73e0-4a37-8e43-c1cb54eed2d4 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-26f4cc86-592f-4657-9d5e-2e2bc0635ef4 tempest-AttachSCSIVolumeTestJSON-648475788 tempest-AttachSCSIVolumeTestJSON-648475788-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4" status: 404 len: 111 microversion: 2.1 time: 0.033725 Apr 18 15:24:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 65/198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:21 2023] GET /compute/v2.1/servers/8a60c305-73e0-4a37-8e43-c1cb54eed2d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:26 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:26 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6e209af8-096b-4a41-b4d1-60168c0a526e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.408390 Apr 18 15:24:26 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:24:26 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083/os-interface => generated 283 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:27 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:27 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:27 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] Creating event network-changed:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:24:27 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-a9caafdb-e92c-438e-ab64-768fa5e43ec9 req-307511bc-fc7b-4dd4-8bba-002d9df07aac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Apr 18 15:24:27 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2063576296"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:27 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:28 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-7aabe337-3085-4d7a-a169-0e21496da556 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f" status: 200 len: 1496 microversion: 2.1 time: 0.676081 Apr 18 15:24:28 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:27 2023] GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f => generated 1496 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-002c3d6e-0c4a-4506-92f8-4c5ba5f34f9e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083/action" status: 202 len: 0 microversion: 2.1 time: 1.012386 Apr 18 15:24:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 66/202] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 15:24:27 2023] POST /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 15:24:28 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-080ff9be-be86-46ae-9ccd-f1e2c6943ca5 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '.version_select at 0x7fc26aeceef0>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:28 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-080ff9be-be86-46ae-9ccd-f1e2c6943ca5 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a" status: 200 len: 1611 microversion: 2.1 time: 0.057411 Apr 18 15:24:28 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 15:24:28 2023] GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a => generated 1611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:31 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-abf3c9ae-882a-4df8-802d-c48668a5fbdf tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Action: 'create', calling method: .version_select at 0x7fc26aa3dab0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-882857501", "metadata": {"Type": "work"}}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-abf3c9ae-882a-4df8-802d-c48668a5fbdf tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.629082 Apr 18 15:24:31 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 70/204] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 15:24:31 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 631 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 15:24:32 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6831a512-1a7c-40c6-9435-3a2fd2dbe49f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Calling method '.version_select at 0x7fc26c3efb50>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6831a512-1a7c-40c6-9435-3a2fd2dbe49f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e" status: 200 len: 349 microversion: 2.1 time: 0.054063 Apr 18 15:24:32 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:24:32 2023] GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:33 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-ea440d1c-193d-41ba-a1ec-0096bf34413f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Calling method '.version_select at 0x7fc26acd8ee0>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:33 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-ea440d1c-193d-41ba-a1ec-0096bf34413f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e" status: 200 len: 349 microversion: 2.1 time: 0.057333 Apr 18 15:24:33 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:24:33 2023] GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e => generated 349 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:24:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-290fc4cb-9c66-4c30-baa0-3ac77d5ec06f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Calling method '.version_select at 0x7fc26aa3f640>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-290fc4cb-9c66-4c30-baa0-3ac77d5ec06f tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e" status: 202 len: 0 microversion: 2.1 time: 0.125156 Apr 18 15:24:33 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 71/207] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:24:33 2023] DELETE /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:24:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5cc6f5d5-71d3-416a-9c97-56ec7e42a804 tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Calling method '.version_select at 0x7fc26acc5b40>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-5cc6f5d5-71d3-416a-9c97-56ec7e42a804 tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] HTTP exception thrown: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. Apr 18 15:24:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5cc6f5d5-71d3-416a-9c97-56ec7e42a804 tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Request method failure captured: Apr 18 15:24:33 user devstack@n-api.service[61366]: request: GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e HTTP/1.1 Apr 18 15:24:33 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:24:33 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:24:33 user devstack@n-api.service[61366]: Connection: close Apr 18 15:24:33 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:24:33 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:24:33 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:24:33 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:24:33 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrYvFmcMjiS241qnVx7nAqjhO8vIiwG3JdAIKqwWITm80Ty0kFts1enprrafkB-8CppQ49bgZFmoJUalbEv9RuFsKBhppRvF2qXWcrLYOtnFBuNhXnNTZOAMCmS71a2huoJMGNc6zduZmJsvcr-PzgbfxASQ5Y9o1mpYPfRyuamnbrU Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Project-Id: 2ae6857325ef42ae950e96ed24b3ce46 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesGetTestJSON-203271266 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ae6857325ef42ae950e96ed24b3ce46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ae6857325ef42ae950e96ed24b3ce46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ae6857325ef42ae950e96ed24b3ce46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesGetTestJSON-203271266 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Tenant-Id: 2ae6857325ef42ae950e96ed24b3ce46 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesGetTestJSON-203271266 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-User: tempest-VolumesGetTestJSON-203271266-project-member Apr 18 15:24:33 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:24:33 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:24:33 user devstack@n-api.service[61366]: X-User-Id: 3e96ce633ae44841af615aa9272d0c90 Apr 18 15:24:33 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesGetTestJSON-203271266-project-member Apr 18 15:24:33 user devstack@n-api.service[61366]: method: Apr 18 15:24:33 user devstack@n-api.service[61366]: exception: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. Apr 18 15:24:33 user devstack@n-api.service[61366]: action_args: {'id': 'a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e'} Apr 18 15:24:33 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. (HTTP 404) (Request-ID: req-fb08f255-e5b1-4667-95b0-22f80f88a553) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. Apr 18 15:24:33 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:24:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5cc6f5d5-71d3-416a-9c97-56ec7e42a804 tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] Returning 404 to user: Volume a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5cc6f5d5-71d3-416a-9c97-56ec7e42a804 tempest-VolumesGetTestJSON-203271266 tempest-VolumesGetTestJSON-203271266-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e" status: 404 len: 109 microversion: 2.1 time: 0.036968 Apr 18 15:24:33 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:24:33 2023] GET /compute/v2.1/os-volumes/a73a0fd7-4ca8-45eb-bcb7-a39dc40f4c4e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=13 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: 03c7e520-78d4-489c-81aa-c9a6d27b2b62] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:39 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] HTTP exception thrown: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Request method failure captured: Apr 18 15:24:39 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 HTTP/1.1 Apr 18 15:24:39 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:24:39 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:24:39 user devstack@n-api.service[61367]: Connection: close Apr 18 15:24:39 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:24:39 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:24:39 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:24:39 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:24:39 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrWBXR9okcTXKDlIjCuvLDFpFB6ld5EleQv6GRt6AHN6P7CZbsXeolczqz0N-c2io1LChhFF8SVpkAvAkMDuXT5UUUgdHfE17-X72wMxXFq-rMkbxxYnLcBTKg0oh0YY4wKUVgz-_zW9pKYQALsM9Nveldmf46hr-i_ZhiDoZ1RpWGE Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Project-Id: ea063b1ab78f47d7aaa62a98e71cc89d Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Project-Name: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Tenant: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Tenant-Id: ea063b1ab78f47d7aaa62a98e71cc89d Apr 18 15:24:39 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:24:39 user devstack@n-api.service[61367]: X-User: tempest-TestMinimumBasicScenario-529089331-project-member Apr 18 15:24:39 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:24:39 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:24:39 user devstack@n-api.service[61367]: X-User-Id: ff9093e866924885b8b5cf1893f69b49 Apr 18 15:24:39 user devstack@n-api.service[61367]: X-User-Name: tempest-TestMinimumBasicScenario-529089331-project-member Apr 18 15:24:39 user devstack@n-api.service[61367]: method: > Apr 18 15:24:39 user devstack@n-api.service[61367]: exception: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. Apr 18 15:24:39 user devstack@n-api.service[61367]: action_args: {'id': '03c7e520-78d4-489c-81aa-c9a6d27b2b62'} Apr 18 15:24:39 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. Apr 18 15:24:39 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:24:39 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Returning 404 to user: Instance 03c7e520-78d4-489c-81aa-c9a6d27b2b62 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:24:39 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-06ec888f-a81a-40fc-9657-83761ac58fda tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62" status: 404 len: 111 microversion: 2.1 time: 0.042232 Apr 18 15:24:39 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:39 2023] GET /compute/v2.1/servers/03c7e520-78d4-489c-81aa-c9a6d27b2b62 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:24:39 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=3 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:39 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=10 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:39 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-96729505-4550-4300-bc2a-a13655b66475 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '.version_select at 0x7fc26aa3f130>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:39 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-96729505-4550-4300-bc2a-a13655b66475 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-781805728" status: 202 len: 0 microversion: 2.1 time: 0.025041 Apr 18 15:24:39 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 18 15:24:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-781805728 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:24:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:41 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-08fff594-1b18-424d-923a-5b1e1a16c73b tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Action: 'create', calling method: .version_select at 0x7fc26bf32c20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-960140690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAEjsfnZ9+34omnAOMkdJLBMb2zuPlMfMEKPbKExxOe9VpUyhWg3S3OK31VdJIQkODsgxYtKCPwo3gwhPboKkwRWQeeEfdyq5eRDlWqsMHqzdJYaczL2NAR3jLJEXWd7w=="}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:41 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-08fff594-1b18-424d-923a-5b1e1a16c73b tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:24:41 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-08fff594-1b18-424d-923a-5b1e1a16c73b tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for user ff9093e866924885b8b5cf1893f69b49 and project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'key_pairs'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:24:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-08fff594-1b18-424d-923a-5b1e1a16c73b tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051156 Apr 18 15:24:41 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 69/211] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:24:41 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:41 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-979661342", "imageRef": "7c3280dc-0bf5-4ab4-b4b2-7e16899c431d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-960140690", "networks": [{"uuid": "5eb6340b-662b-4b7c-9cf0-bb581a99996c"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] validate_networks() for [('5eb6340b-662b-4b7c-9cf0-bb581a99996c', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Getting quotas for user ff9093e866924885b8b5cf1893f69b49 and project ea063b1ab78f47d7aaa62a98e71cc89d. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:24:42 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c3280dc-0bf5-4ab4-b4b2-7e16899c431d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:24:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-fb703b45-1da3-42a9-8eeb-2e95696f51dc tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.888677 Apr 18 15:24:42 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:24:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:24:42 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0dbbd87a-7a38-4de8-964f-aeec491013ff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:42 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0dbbd87a-7a38-4de8-964f-aeec491013ff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:43 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-0dbbd87a-7a38-4de8-964f-aeec491013ff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0dbbd87a-7a38-4de8-964f-aeec491013ff tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 200 len: 1251 microversion: 2.1 time: 0.187510 Apr 18 15:24:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:42 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 1251 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:45 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:45 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] Creating event network-changed:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:24:45 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-fb20ec45-6234-4678-9519-ab441cbee503 req-df87b281-718e-41cf-9d08-9f87af68ebf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029995 Apr 18 15:24:45 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 70/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:47 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-b35fd275-7147-470a-abcd-ce6f3773098d tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 200 len: 1545 microversion: 2.1 time: 0.210297 Apr 18 15:24:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:47 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 1545 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:24:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-7b755bef-45dd-4e59-93a3-fae439632c2b req-e7ac9e3e-f5f4-4284-8a58-e17f3247f595 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048272 Apr 18 15:24:47 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 74/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:48 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:24:48 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-94aa4c8c-445a-4a06-b3b2-32344438f1e4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 204 len: 0 microversion: 2.1 time: 0.118016 Apr 18 15:24:48 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:24:48 2023] DELETE /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:48 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-44e2da8b-2a73-4fa7-8ec3-e0f55cf4835e tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 200 len: 1691 microversion: 2.87 time: 0.259824 Apr 18 15:24:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 71/218] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:24:48 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:49 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-174d5abc-eea8-411d-8157-44d2f22342e3 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 200 len: 1500 microversion: 2.1 time: 0.299323 Apr 18 15:24:49 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 75/219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:48 2023] GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "name": "network-vif-unplugged", "status": "completed", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] Creating event network-vif-unplugged:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:24:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-0b481e8c-fce9-4de1-8d94-bf8e35027e02 req-23e67295-2efa-44c9-bf7c-b79fee8ae7ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031496 Apr 18 15:24:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:24:49 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-949edee8-139e-416e-855d-a9d5bbee89fa req-8f734489-0250-4057-8ca5-3ab1a01ab562 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034003 Apr 18 15:24:49 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 76/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-1c874569-ee37-4c2e-88ef-19bf253b0819 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1540 microversion: 2.1 time: 0.340097 Apr 18 15:24:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 72/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:49 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1540 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:24:51 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "name": "network-vif-plugged", "status": "completed", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}, {"server_uuid": "e51d313c-74bf-4c97-bf95-4c1dc78b65e3", "name": "network-vif-deleted", "tag": "45881717-572d-45f1-bdcc-a33a3ae90b75"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:24:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Creating event network-vif-plugged:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:24:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] Creating event network-vif-deleted:45881717-572d-45f1-bdcc-a33a3ae90b75 for instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 on user Apr 18 15:24:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-43ae71b0-c31d-4c7b-89ed-f0f5f7c69055 req-612e8624-7055-412a-bc92-9aced7256f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032079 Apr 18 15:24:51 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:24:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:24:54 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:24:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-8396c498-6752-467f-bd50-7f51fc933269 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 200 len: 1536 microversion: 2.1 time: 0.221288 Apr 18 15:24:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 77/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:24:54 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 1536 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=14 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-cce8ad5d-7170-4ed5-9398-ba6efc2ee41e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '.version_select at 0x7fc26acc5090>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:18 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-cce8ad5d-7170-4ed5-9398-ba6efc2ee41e tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a" status: 200 len: 1725 microversion: 2.1 time: 0.061782 Apr 18 15:25:18 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 73/225] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 15:25:18 2023] GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a => generated 1725 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:18 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-6f7a12b2-84a2-4aa2-8276-4f8e4f7d1c28 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '.version_select at 0x7fc26acd8d30>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:18 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-6f7a12b2-84a2-4aa2-8276-4f8e4f7d1c28 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a" status: 200 len: 1725 microversion: 2.1 time: 0.066111 Apr 18 15:25:18 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 15:25:18 2023] GET /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a => generated 1725 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=16 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:19 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0641255c4ab044a69d49dea48cb09f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe55073a1046539025c5b8f35c456a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a25b594f-33d8-472d-8212-548c3a06bb9a tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 200 len: 1672 microversion: 2.1 time: 0.225214 Apr 18 15:25:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 78/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:19 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:30 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:25:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-41acd603-8b12-4940-a94a-d3ff0cae7add tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f" status: 204 len: 0 microversion: 2.1 time: 0.115927 Apr 18 15:25:30 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 74/228] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:25:30 2023] DELETE /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "name": "network-vif-unplugged", "status": "completed", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:30 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] Creating event network-vif-unplugged:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:25:30 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:30 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-3148a466-5d37-437c-b9bf-3b904819f4f5 req-092394b8-f783-44ac-b579-a1ffb13bbb0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033582 Apr 18 15:25:30 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 79/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-bda7ff17-8e4a-4652-8640-db44fc7c8fda tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f" status: 200 len: 1502 microversion: 2.1 time: 0.253304 Apr 18 15:25:30 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:30 2023] GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f => generated 1502 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:31 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "name": "network-vif-deleted", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:31 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] Creating event network-vif-deleted:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:25:31 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c244d361-ea73-4318-864c-7fcb7fbf41f1 req-10c14445-b061-4b7c-bf19-f6280fa36fb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Apr 18 15:25:31 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 75/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:32 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4b765cc-7b99-49dc-b879-abbec0414f0f", "name": "network-vif-plugged", "status": "completed", "tag": "e4e73bc7-ec52-401d-8580-3bd6f82abc26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:32 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] Creating event network-vif-plugged:e4e73bc7-ec52-401d-8580-3bd6f82abc26 for instance f4b765cc-7b99-49dc-b879-abbec0414f0f on user Apr 18 15:25:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d4f3f0d8-af5f-4953-b1f9-366a752ee619 req-a954b2cd-38d3-4ee7-9d03-509d8d7daca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027722 Apr 18 15:25:32 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 80/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:33 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:33 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-0a1dfede-8cd1-4b12-816a-32652beb42f0 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 200 len: 1536 microversion: 2.1 time: 0.206560 Apr 18 15:25:33 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:33 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 1536 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] HTTP exception thrown: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Request method failure captured: Apr 18 15:25:39 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 HTTP/1.1 Apr 18 15:25:39 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:25:39 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:25:39 user devstack@n-api.service[61366]: Connection: close Apr 18 15:25:39 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:25:39 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:25:39 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:25:39 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:25:39 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVfFGRoJ2sVTPVsZBZ-yP8hZOjP1LzsXuzOMffUrfz2VSu48XsrG05ldsthSvlu-cuO5Fp8cx5FzZn7ThuIpikmWD6F52EVHD81MbpQflLFuzBrzDbV8kehNMR-catQgBVHwMopVhvFhBEl0a0dBRlhalq80Ulex2vxDyZEChHHAXg Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Project-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Tenant: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Tenant-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:25:39 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:25:39 user devstack@n-api.service[61366]: X-User: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:25:39 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:25:39 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:25:39 user devstack@n-api.service[61366]: X-User-Id: 99cb7e246c95430e8324dfa9ee5dd10f Apr 18 15:25:39 user devstack@n-api.service[61366]: X-User-Name: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:25:39 user devstack@n-api.service[61366]: method: > Apr 18 15:25:39 user devstack@n-api.service[61366]: exception: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:25:39 user devstack@n-api.service[61366]: action_args: {'id': 'e51d313c-74bf-4c97-bf95-4c1dc78b65e3'} Apr 18 15:25:39 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:25:39 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:25:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Returning 404 to user: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:25:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0d836d3d-bbb1-4054-b867-513598d5c83a tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 404 len: 111 microversion: 2.1 time: 0.027499 Apr 18 15:25:39 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 76/234] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:39 2023] GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:39 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:39 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a35b28b9-7f6a-4470-8bab-08bce9b89819 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1495 microversion: 2.1 time: 0.222055 Apr 18 15:25:39 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 81/235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:39 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1495 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=12 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-9d610a48-f12b-4110-bff3-c45ff29c606b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.169191 Apr 18 15:25:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:25:47 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1/os-interface => generated 283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] Creating event network-changed:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:25:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4660cf31-4c5a-4593-a2d8-2a2fe0e7c9d8 req-82ae1914-fb85-48ef-af3a-c2894b9cce82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Apr 18 15:25:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 77/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6ce54772-818e-4508-a0d8-49a708b51710 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1/ips" status: 200 len: 108 microversion: 2.1 time: 0.044177 Apr 18 15:25:48 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 82/238] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:25:48 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1/ips => generated 108 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-622121921", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "6b431f75-004a-45be-9f0d-ec0a00baad53"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] validate_networks() for [('6b431f75-004a-45be-9f0d-ec0a00baad53', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for user 7c813fea447b4ddd8d0f09078f4f173c and project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:25:49 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:25:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-bb147e6b-7bd1-41be-a6f5-d26533ad13df tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.602202 Apr 18 15:25:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 80/239] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:25:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:25:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:49 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:49 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-94ced1d1-1116-468b-8a32-e8e99a2c2e98 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84" status: 200 len: 1394 microversion: 2.87 time: 0.084227 Apr 18 15:25:49 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 78/240] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:25:49 2023] GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84 => generated 1394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:25:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:25:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6c911add-4fb4-4005-ba70-310e446a3196 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 204 len: 0 microversion: 2.1 time: 0.310892 Apr 18 15:25:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 83/241] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:25:49 2023] DELETE /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:50 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-4f9dc8c8-21c5-4a51-8868-81374dd79b6b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.252530 Apr 18 15:25:50 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:25:50 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6/os-interface => generated 282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:50 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ae5bf1bf-1651-440b-8e80-a7a133192eae tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 200 len: 1670 microversion: 2.1 time: 0.295358 Apr 18 15:25:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 79/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:50 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "name": "network-vif-unplugged", "status": "completed", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] Creating event network-vif-unplugged:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:25:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-11873c84-4e2a-4af9-8053-f6b54fc447bf req-64b14c0e-a93b-44a1-b39b-25f3301e040d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038075 Apr 18 15:25:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 84/244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:51 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:51 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] Creating event network-changed:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:25:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-40f6b3f9-3d4a-4b73-9c49-cf3dba1576e8 req-1b44a93c-77c7-4d39-b149-613469018117 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029889 Apr 18 15:25:51 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 82/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:51 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:51 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a5524d08-70f9-4540-9106-337c27a9b0d0 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1540 microversion: 2.1 time: 0.341186 Apr 18 15:25:51 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 80/246] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:51 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1540 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:51 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-31011c3f-0d39-4899-b5dd-54525459388e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1540 microversion: 2.1 time: 0.430398 Apr 18 15:25:51 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 85/247] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:51 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1540 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:52 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "name": "network-vif-deleted", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:52 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:52 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] Creating event network-vif-deleted:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:25:52 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-29c0ad4e-a87c-44d5-924a-913edd7d21d0 req-6808f269-51c6-4072-916b-5708bdc03fa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036037 Apr 18 15:25:52 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:52 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af338c6-31de-4068-b172-40d4a94552a1", "name": "network-vif-plugged", "status": "completed", "tag": "7f1295ff-9034-4db2-b581-1091fd7b7b5c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:52 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] Creating event network-vif-plugged:7f1295ff-9034-4db2-b581-1091fd7b7b5c for instance 0af338c6-31de-4068-b172-40d4a94552a1 on user Apr 18 15:25:52 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4cf35ebc-b0bc-48e9-80fb-222165967238 req-8e1c83ad-6ec9-479b-9ec8-cd051b68380d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032943 Apr 18 15:25:52 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 81/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:54 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:54 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b9ee73-17c5-470e-96f9-1f8dc1998e84", "tag": "00e4993c-b028-4d86-93cd-3fcfebeba5e7"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:54 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] Creating event network-changed:00e4993c-b028-4d86-93cd-3fcfebeba5e7 for instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 on user Apr 18 15:25:54 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-2722199f-696a-41ca-b6cc-b25158b07759 req-e4628ca3-b973-47b6-a3df-0f4016022999 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029547 Apr 18 15:25:54 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:54 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d0bb2c5c-4f75-41b5-9207-b5d6e3c5f40f tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.242774 Apr 18 15:25:54 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 86/251] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:25:54 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138/os-interface => generated 283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:55 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:55 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:55 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:55 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] Creating event network-changed:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:25:55 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-606b856d-2403-4e92-b7ea-7b6fa3375384 req-01c57fe3-52ed-4490-b5fd-b11b1e06bd89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Apr 18 15:25:55 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 82/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:55 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:55 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f108f1fa-f95a-4686-b8f2-ae8aed6cf6b5 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138/ips" status: 200 len: 105 microversion: 2.1 time: 0.033897 Apr 18 15:25:55 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:25:55 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138/ips => generated 105 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:25:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d9b4e35e-9305-4921-8b1b-945b48f20d45 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 204 len: 0 microversion: 2.1 time: 0.111269 Apr 18 15:25:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 87/254] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:25:57 2023] DELETE /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c133acd96c98486fac2085187824d10b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7269241b8f244a86b51580dd6319d5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:25:57 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-fb49469a-aed4-46cf-ae87-2d6bb1b65264 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 200 len: 1661 microversion: 2.1 time: 0.261486 Apr 18 15:25:57 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 83/255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:25:57 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 1661 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:25:57 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "name": "network-vif-unplugged", "status": "completed", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] Creating event network-vif-unplugged:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:25:57 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-0d249b8e-d76b-4a59-8588-1448895b3a73 req-888bf795-2a24-4023-a9b1-7566249eb7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027207 Apr 18 15:25:57 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b9ee73-17c5-470e-96f9-1f8dc1998e84", "name": "network-vif-deleted", "tag": "00e4993c-b028-4d86-93cd-3fcfebeba5e7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:57 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.compute.server_external_events [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] Unable to find a host for instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84. Dropping event network-vif-deleted {{(pid=61365) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 15:25:57 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-74cbe422-95b4-434b-a324-a5de6f11f976 req-befef702-2a4d-4f07-85f6-9087e2294efe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.025895 Apr 18 15:25:57 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 88/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:57 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 15:25:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "name": "network-vif-plugged", "status": "completed", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] Creating event network-vif-plugged:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:25:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-2d8b3cc2-e3f6-4cdb-b347-761dab8333b2 req-3e1d6ca3-3985-443d-a69d-55f3983c5a7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028060 Apr 18 15:25:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 84/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45163f1f-e814-4801-95cc-4a1d5d232138", "name": "network-vif-deleted", "tag": "4d94c0a0-156f-49b6-8b4e-70d3346ee8ed"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:25:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:25:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] Creating event network-vif-deleted:4d94c0a0-156f-49b6-8b4e-70d3346ee8ed for instance 45163f1f-e814-4801-95cc-4a1d5d232138 on user Apr 18 15:25:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-d276380b-6a66-43a3-a691-e6754d884cd4 req-fbf717a7-c6f0-4ace-8f26-2d7f208b0c76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 Apr 18 15:25:59 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:19 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0641255c4ab044a69d49dea48cb09f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe55073a1046539025c5b8f35c456a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-b43de293-208a-43e9-a4e7-b37fb002f818 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 200 len: 1672 microversion: 2.1 time: 0.359639 Apr 18 15:26:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 89/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:19 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 1672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: f4b765cc-7b99-49dc-b879-abbec0414f0f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] HTTP exception thrown: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Request method failure captured: Apr 18 15:26:20 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f HTTP/1.1 Apr 18 15:26:20 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:26:20 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:26:20 user devstack@n-api.service[61366]: Connection: close Apr 18 15:26:20 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:26:20 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:26:20 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:26:20 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:26:20 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVni09qX-qOpNlSKMszzXKjzz8cI6HDQyc_ygwckkSDnZbLOTI3LDtcYQpBBZ4cz35SlXVlQJn3E4Cenlmjxg8zADqjvCzTdIu9eiq43Cgr_8A9PO9Vcnhi3EHdU-r2dhdgENdeL5-eaU_rrstTc9H6Ak_g_9k1w4jt2VhyBmPR-jc Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Project-Id: 8c34ff3309c74223b4c2e3e7f6698860 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Tenant-Id: 8c34ff3309c74223b4c2e3e7f6698860 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-User: tempest-VolumesAdminNegativeTest-577927350-project-member Apr 18 15:26:20 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:26:20 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:26:20 user devstack@n-api.service[61366]: X-User-Id: fb1187e621234a18a337d8bae5c59ec3 Apr 18 15:26:20 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesAdminNegativeTest-577927350-project-member Apr 18 15:26:20 user devstack@n-api.service[61366]: method: > Apr 18 15:26:20 user devstack@n-api.service[61366]: exception: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. Apr 18 15:26:20 user devstack@n-api.service[61366]: action_args: {'id': 'f4b765cc-7b99-49dc-b879-abbec0414f0f'} Apr 18 15:26:20 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. Apr 18 15:26:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Returning 404 to user: Instance f4b765cc-7b99-49dc-b879-abbec0414f0f could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d6c78653-c070-4565-a083-44de7b70418c tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f" status: 404 len: 111 microversion: 2.1 time: 0.038565 Apr 18 15:26:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 85/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:20 2023] GET /compute/v2.1/servers/f4b765cc-7b99-49dc-b879-abbec0414f0f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=24 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:20 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:26:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-ce0a706f-5695-4573-b025-ffa9ce6b268e tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd" status: 204 len: 0 microversion: 2.1 time: 0.113223 Apr 18 15:26:20 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:26:20 2023] DELETE /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1187e621234a18a337d8bae5c59ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c34ff3309c74223b4c2e3e7f6698860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6187fc31-2c51-4935-8c4e-12dbed86ca97 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd" status: 200 len: 1670 microversion: 2.1 time: 0.323400 Apr 18 15:26:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:20 2023] GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd => generated 1670 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] Creating event network-vif-unplugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-38a52c57-6291-46c8-aaed-93bc15f7cefc req-cf6d6b9d-ea87-48c2-84a2-2e1308f1e2eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101882 Apr 18 15:26:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 86/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f3661003-e878-4b16-8d4f-2ae0f82357e3 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '.version_select at 0x7fc26aecf1c0>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f3661003-e878-4b16-8d4f-2ae0f82357e3 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a" status: 204 len: 0 microversion: 2.1 time: 0.403578 Apr 18 15:26:21 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:21 2023] DELETE /compute/v2.1/images/47e15426-9f74-439c-877a-aaec636ab30a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:26:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-af788f0f-1f90-497e-904e-2c873468d829 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 204 len: 0 microversion: 2.1 time: 0.136371 Apr 18 15:26:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 91/266] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:26:21 2023] DELETE /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:22 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0641255c4ab044a69d49dea48cb09f9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fbe55073a1046539025c5b8f35c456a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:22 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-db5bc71d-4f5d-4396-87c8-76706559a78f tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 200 len: 1678 microversion: 2.1 time: 0.373969 Apr 18 15:26:22 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 87/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:22 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 1678 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:22 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-deleted", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:22 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] Creating event network-vif-deleted:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:22 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-1e7de2e1-df0b-4bf7-8a38-db967d069f89 req-af9e9d6a-57e1-4936-8c82-4fac1fb6ef51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091743 Apr 18 15:26:22 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:23 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}, {"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}, {"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}, {"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}, {"server_uuid": "467ddcb5-c0b8-43bd-8a39-35b35b57f0fd", "name": "network-vif-plugged", "status": "completed", "tag": "8bc44429-4246-41f6-ad97-13ae72c79074"}, {"server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "name": "network-vif-unplugged", "status": "completed", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:23 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-unplugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-plugged:8bc44429-4246-41f6-ad97-13ae72c79074 for instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] Creating event network-vif-unplugged:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:26:23 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-5e5438ae-d946-4573-9868-70b610243a3d req-c436935e-7355-456d-8866-293c3a79dae1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.036912 Apr 18 15:26:23 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 92/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:24 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "name": "network-vif-deleted", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:24 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] Creating event network-vif-deleted:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:26:24 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-6169d7e7-eb05-4d93-8225-c0482affd706 req-f570c573-0be5-40cd-9272-3cfa7c19c8f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030641 Apr 18 15:26:24 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 88/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:25 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8947976e-1dbd-42fe-abfd-9c303bb36083", "name": "network-vif-plugged", "status": "completed", "tag": "2e74270d-de09-492c-8304-f0ba941477a3"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:25 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] Creating event network-vif-plugged:2e74270d-de09-492c-8304-f0ba941477a3 for instance 8947976e-1dbd-42fe-abfd-9c303bb36083 on user Apr 18 15:26:25 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-3a3aee08-ebf5-4517-803e-32e2450da840 req-3324240d-1c6f-4639-acdb-d974deca2e4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028854 Apr 18 15:26:25 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 91/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:33 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:33 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-11a127b6-dc8a-4f74-ac84-5f3f1889808a tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 200 len: 1536 microversion: 2.1 time: 0.251060 Apr 18 15:26:33 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 93/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:33 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 1536 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Searching by: {'deleted': False, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d'} {{(pid=61366) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:33 user devstack@n-api.service[61366]: DEBUG nova.compute.multi_cell_list [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61366) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 15:26:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-532af275-9924-469a-a694-21297d7dd8e6 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.194348 Apr 18 15:26:33 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 89/273] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 15:26:33 2023] GET /compute/v2.1/servers => generated 340 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:33 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:34 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:34 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-eca0c1ce-e303-4594-81b9-080bedd57637 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 200 len: 1536 microversion: 2.1 time: 0.225593 Apr 18 15:26:34 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:33 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 1536 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:35 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:26:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d6ede79b-9117-44f9-b11b-31e5af1c1b14 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 204 len: 0 microversion: 2.1 time: 0.359428 Apr 18 15:26:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 94/275] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:26:35 2023] DELETE /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:36 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9093e866924885b8b5cf1893f69b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea063b1ab78f47d7aaa62a98e71cc89d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:36 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-25e9a077-74b8-43ee-adec-7b99da8da563 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 200 len: 1542 microversion: 2.1 time: 0.168575 Apr 18 15:26:36 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 90/276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:36 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 1542 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:36 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-unplugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:36 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:36 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:36 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:36 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] Creating event network-vif-unplugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:36 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-2fe49c0f-5bd2-4850-8fc3-21aca938f4e0 req-d0f1d2b4-87bd-4e6d-a1a2-19f940be96cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028321 Apr 18 15:26:36 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-deleted", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] Creating event network-vif-deleted:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-961045dd-b248-45b6-bb69-4f02d4c070cf req-25f89bbe-292d-40f1-902b-43b4291abc5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029344 Apr 18 15:26:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 95/278] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}, {"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}, {"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}, {"server_uuid": "e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4", "name": "network-vif-plugged", "status": "completed", "tag": "f9d16139-0a1e-4588-9cbf-129558de770c"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] Creating event network-vif-plugged:f9d16139-0a1e-4588-9cbf-129558de770c for instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 on user Apr 18 15:26:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a5b1c666-fea2-4ce4-ba24-881205ab9bbd req-f2a5c050-fb31-4bb3-acb0-bf2471ff0b6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032119 Apr 18 15:26:38 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 91/279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:38 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.objects.instance [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lazy-loading 'fault' on Instance uuid c8b9ee73-17c5-470e-96f9-1f8dc1998e84 {{(pid=61367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:39 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:39 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-76ede50d-b2a3-4f12-b647-b2317c27fb30 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84" status: 200 len: 1649 microversion: 2.87 time: 0.107116 Apr 18 15:26:39 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:26:39 2023] GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84 => generated 1649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Doing local delete in cell d27f661e-81e7-4e06-bd8c-c3069818de01(cell1) {{(pid=61365) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] instance's host None is down, deleting from database Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] deallocate_for_instance() {{(pid=61365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Instance cache missing network info. {{(pid=61365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Updating instance_info_cache with network_info: [] {{(pid=61365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61365) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 15:26:40 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 15:26:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-0e3b58e8-84a0-4316-908f-b64fdac5b041 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84" status: 204 len: 0 microversion: 2.87 time: 0.512479 Apr 18 15:26:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 96/281] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:26:40 2023] DELETE /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: c8b9ee73-17c5-470e-96f9-1f8dc1998e84] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] HTTP exception thrown: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Request method failure captured: Apr 18 15:26:40 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84 HTTP/1.1 Apr 18 15:26:40 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:26:40 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:26:40 user devstack@n-api.service[61367]: Connection: close Apr 18 15:26:40 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:26:40 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:26:40 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:26:40 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:26:40 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrWX0AuuOO2gsKnEM3hzJ9VSUy8ACp-JnjofyWiwOeB8Kmv1l5KpUCn7yWKNKnsd7LRJ6r-LthcTkNj3744LgUDS753JpgfrCinqXG9HB1QgTilBaAbq_mevS9fNJxujVpKL4ElmDuMoijGUAZEximNy_AWQ-yR7EoNoNBaLiMJR_fQ Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Project-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Tenant-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:26:40 user devstack@n-api.service[61367]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:26:40 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:26:40 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:26:40 user devstack@n-api.service[61367]: X-User-Id: 7c813fea447b4ddd8d0f09078f4f173c Apr 18 15:26:40 user devstack@n-api.service[61367]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:26:40 user devstack@n-api.service[61367]: method: > Apr 18 15:26:40 user devstack@n-api.service[61367]: exception: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61367]: action_args: {'id': 'c8b9ee73-17c5-470e-96f9-1f8dc1998e84'} Apr 18 15:26:40 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Returning 404 to user: Instance c8b9ee73-17c5-470e-96f9-1f8dc1998e84 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-75f01163-02c7-4085-80eb-6aafb305d1ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84" status: 404 len: 111 microversion: 2.87 time: 0.027540 Apr 18 15:26:40 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 95/282] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:26:40 2023] GET /compute/v2.1/servers/c8b9ee73-17c5-470e-96f9-1f8dc1998e84 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:26:40 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 HTTP/1.1 Apr 18 15:26:40 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:26:40 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:26:40 user devstack@n-api.service[61366]: Connection: close Apr 18 15:26:40 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:26:40 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:26:40 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:26:40 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:26:40 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:26:40 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:26:40 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:26:40 user devstack@n-api.service[61366]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:26:40 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:26:40 user devstack@n-api.service[61366]: method: > Apr 18 15:26:40 user devstack@n-api.service[61366]: exception: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61366]: action_args: {'id': '0af338c6-31de-4068-b172-40d4a94552a1'} Apr 18 15:26:40 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:26:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f5ac00b5-b6ef-4836-959b-90ec67332e38 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 404 len: 111 microversion: 2.1 time: 0.174318 Apr 18 15:26:40 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 92/283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:40 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-cb7ce2e3-935f-4eaf-8de7-d73ebcbf68d2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '.version_select at 0x7fc26aa3cdc0>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-cb7ce2e3-935f-4eaf-8de7-d73ebcbf68d2 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759299414" status: 202 len: 0 microversion: 2.1 time: 0.021919 Apr 18 15:26:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 97/284] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:26:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759299414 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1896656006", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "networks": [{"uuid": "6b431f75-004a-45be-9f0d-ec0a00baad53"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:40 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] validate_networks() for [('6b431f75-004a-45be-9f0d-ec0a00baad53', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-c3132c3e-14ea-43ce-bcd5-d2619cd503bb tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: .version_select at 0x7fc26a92c430>, body: {"keypair": {"name": "tempest-keypair-1315550948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmIAlikHNXYI6WdMeuTGACeDWnP867p0MimK+yG4walSyMDeK/HdHqPDDRcSUA7Sc9NaHfiDr6qLi42PXuJimVTb0yMsquKY86uJGM0bLYl9rziZKQ9/p0ZAKKJt1Tf2g=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-c3132c3e-14ea-43ce-bcd5-d2619cd503bb tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-c3132c3e-14ea-43ce-bcd5-d2619cd503bb tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:26:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-c3132c3e-14ea-43ce-bcd5-d2619cd503bb tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046717 Apr 18 15:26:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 98/285] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:26:41 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for user 7c813fea447b4ddd8d0f09078f4f173c and project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:26:41 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:26:41 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:41 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-46181ceb-e70f-426e-b535-015356328435 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1495 microversion: 2.1 time: 0.542796 Apr 18 15:26:41 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 93/286] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:41 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1495 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:41 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f8aa802b-bee4-4841-b89c-48e454e1199c tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.007764 Apr 18 15:26:41 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 96/287] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:26:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:41 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3adfdec2-37b5-4a78-8813-9dbacb3549da tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 200 len: 1395 microversion: 2.87 time: 0.068443 Apr 18 15:26:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 99/288] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:26:41 2023] GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 1395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:42 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:42 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-0c09759e-0958-4f02-87cd-9084a95120fe tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.382110 Apr 18 15:26:42 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 94/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:42 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:42 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-fa79879e-4669-4db6-8885-38a280cdeb99 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.214821 Apr 18 15:26:42 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 97/290] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:42 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:42 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390221429", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "03193d32-3e21-4e7c-ae10-c5ddd6544407"}], "security_groups": [{"name": "tempest-securitygroup--2132273094"}], "key_name": "tempest-keypair-1315550948", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:43 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] validate_networks() for [('03193d32-3e21-4e7c-ae10-c5ddd6544407', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Getting quotas for user fdecf5faa0a8407e8ee245f30d6eb607 and project 2e45db5645a54c88a6f7780012e87354. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:26:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:26:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-dcd874c0-fee7-45b0-8274-1566e965cab9 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.432950 Apr 18 15:26:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 100/291] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:26:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:26:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5221444a-7205-45ff-beef-0062d79f7a5b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5221444a-7205-45ff-beef-0062d79f7a5b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:44 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:26:44 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-5221444a-7205-45ff-beef-0062d79f7a5b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:26:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5221444a-7205-45ff-beef-0062d79f7a5b tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 200 len: 1235 microversion: 2.1 time: 0.077724 Apr 18 15:26:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 95/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:44 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:26:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:45 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] Creating event network-changed:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:26:45 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-5a3d3e14-870a-467f-aafb-d24025b5160b req-c00c2606-0661-4f4f-bf0a-a075c133683e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028630 Apr 18 15:26:45 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 98/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:47 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] Creating event network-changed:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:26:47 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-c66295d6-5b55-4846-9df7-891815ee9e89 req-7ebb7284-dffe-4f0e-8e27-271a7606b6e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095415 Apr 18 15:26:47 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 101/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:47 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:26:47 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 HTTP/1.1 Apr 18 15:26:47 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:26:47 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:26:47 user devstack@n-api.service[61366]: Connection: close Apr 18 15:26:47 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:26:47 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:26:47 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:26:47 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:26:47 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:47 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:47 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:26:47 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:26:47 user devstack@n-api.service[61366]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:26:47 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:47 user devstack@n-api.service[61366]: method: > Apr 18 15:26:47 user devstack@n-api.service[61366]: exception: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:47 user devstack@n-api.service[61366]: action_args: {'id': '45163f1f-e814-4801-95cc-4a1d5d232138'} Apr 18 15:26:47 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:47 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:47 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f8b03629-8fa8-4710-a2d1-6734e168917a tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 404 len: 111 microversion: 2.1 time: 0.154433 Apr 18 15:26:47 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 96/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:47 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f7cb022e-dca3-4c58-8357-8de785c68e22 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '.version_select at 0x7fc26c3d1990>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f7cb022e-dca3-4c58-8357-8de785c68e22 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071032263" status: 202 len: 0 microversion: 2.1 time: 0.032257 Apr 18 15:26:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 99/296] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:26:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071032263 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:26:48 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 HTTP/1.1 Apr 18 15:26:48 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:26:48 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:26:48 user devstack@n-api.service[61365]: Connection: close Apr 18 15:26:48 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:26:48 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:26:48 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:26:48 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:26:48 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61365]: method: > Apr 18 15:26:48 user devstack@n-api.service[61365]: exception: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: action_args: {'id': '45163f1f-e814-4801-95cc-4a1d5d232138'} Apr 18 15:26:48 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d3ac190a-06ec-4c9b-b30b-5e124164d247 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 404 len: 111 microversion: 2.1 time: 0.032372 Apr 18 15:26:48 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 102/297] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:26:48 2023] DELETE /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: 45163f1f-e814-4801-95cc-4a1d5d232138] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:26:48 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 HTTP/1.1 Apr 18 15:26:48 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:26:48 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:26:48 user devstack@n-api.service[61366]: Connection: close Apr 18 15:26:48 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:26:48 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:26:48 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:26:48 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:26:48 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61366]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:26:48 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61366]: method: > Apr 18 15:26:48 user devstack@n-api.service[61366]: exception: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61366]: action_args: {'id': '45163f1f-e814-4801-95cc-4a1d5d232138'} Apr 18 15:26:48 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance 45163f1f-e814-4801-95cc-4a1d5d232138 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e77fc011-b8c4-4903-8c79-eabe7f6d7315 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138" status: 404 len: 111 microversion: 2.1 time: 0.027921 Apr 18 15:26:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 97/298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:48 2023] GET /compute/v2.1/servers/45163f1f-e814-4801-95cc-4a1d5d232138 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:26:48 user devstack@n-api.service[61367]: request: DELETE /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 HTTP/1.1 Apr 18 15:26:48 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:26:48 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:26:48 user devstack@n-api.service[61367]: Connection: close Apr 18 15:26:48 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:26:48 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:26:48 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:26:48 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:26:48 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61367]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:26:48 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61367]: method: > Apr 18 15:26:48 user devstack@n-api.service[61367]: exception: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61367]: action_args: {'id': 'f420f72a-75b8-4492-936b-652048e06902'} Apr 18 15:26:48 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:48 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-1567a67d-dcea-4793-90ef-7c18122b18e8 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 404 len: 111 microversion: 2.1 time: 0.027320 Apr 18 15:26:48 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:26:48 2023] DELETE /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] [instance: f420f72a-75b8-4492-936b-652048e06902] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] HTTP exception thrown: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Request method failure captured: Apr 18 15:26:48 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 HTTP/1.1 Apr 18 15:26:48 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:26:48 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:26:48 user devstack@n-api.service[61365]: Connection: close Apr 18 15:26:48 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:26:48 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:26:48 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:26:48 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:26:48 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVkfl7g84u9ot4UwzyHvLjTj0oC2jX03z3HX575J9I5_4w_a2ml9mC1m4X1Op2gopClDAFCXYezch0U7EJ4DFso-nU8HpgtGEfeicmMpVyvmtBqd-ulv8EO_T6C_Rjs7SaVJ_36oLykOXaXrZaFaaBkIsJWRWsJfbsWsycEc03aDTU Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7269241b8f244a86b51580dd6319d5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant-Id: 7269241b8f244a86b51580dd6319d5c6 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1284069294 Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Id: c133acd96c98486fac2085187824d10b Apr 18 15:26:48 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeTestJSON-1284069294-project-member Apr 18 15:26:48 user devstack@n-api.service[61365]: method: > Apr 18 15:26:48 user devstack@n-api.service[61365]: exception: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: action_args: {'id': 'f420f72a-75b8-4492-936b-652048e06902'} Apr 18 15:26:48 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. Apr 18 15:26:48 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:26:48 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] Returning 404 to user: Instance f420f72a-75b8-4492-936b-652048e06902 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:26:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ac6c5ebc-f325-439e-a091-638392153760 tempest-AttachVolumeTestJSON-1284069294 tempest-AttachVolumeTestJSON-1284069294-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902" status: 404 len: 111 microversion: 2.1 time: 0.026659 Apr 18 15:26:48 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 103/300] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:26:48 2023] GET /compute/v2.1/servers/f420f72a-75b8-4492-936b-652048e06902 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:26:49 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "name": "network-vif-plugged", "status": "completed", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}, {"server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "name": "network-vif-plugged", "status": "completed", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:49 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Creating event network-vif-plugged:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:26:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] Creating event network-vif-plugged:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:26:49 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4a033e66-29f7-4439-997d-f854ad234d18 req-340b9fb3-800c-4947-a782-22319537aa06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031204 Apr 18 15:26:49 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 98/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:26:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:26:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-93794f65-8d01-4b16-890b-7e6c862cae79 req-9febb48c-57d5-4494-805c-e48125287081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043152 Apr 18 15:26:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:26:51 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:26:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:26:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:26:51 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:26:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:26:51 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d3b0151f-0035-4d00-808b-bfe4134a4c82 req-f659b099-c138-4dc6-bb6e-042b64b5793c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048293 Apr 18 15:26:51 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 104/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=30 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=48 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] [instance: 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] HTTP exception thrown: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Request method failure captured: Apr 18 15:27:11 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd HTTP/1.1 Apr 18 15:27:11 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:27:11 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:27:11 user devstack@n-api.service[61366]: Connection: close Apr 18 15:27:11 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:27:11 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:27:11 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:27:11 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:27:11 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVni09qX-qOpNlSKMszzXKjzz8cI6HDQyc_ygwckkSDnZbLOTI3LDtcYQpBBZ4cz35SlXVlQJn3E4Cenlmjxg8zADqjvCzTdIu9eiq43Cgr_8A9PO9Vcnhi3EHdU-r2dhdgENdeL5-eaU_rrstTc9H6Ak_g_9k1w4jt2VhyBmPR-jc Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Project-Id: 8c34ff3309c74223b4c2e3e7f6698860 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Project-Name: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c34ff3309c74223b4c2e3e7f6698860"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Tenant: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Tenant-Id: 8c34ff3309c74223b4c2e3e7f6698860 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-577927350 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-User: tempest-VolumesAdminNegativeTest-577927350-project-member Apr 18 15:27:11 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:27:11 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:27:11 user devstack@n-api.service[61366]: X-User-Id: fb1187e621234a18a337d8bae5c59ec3 Apr 18 15:27:11 user devstack@n-api.service[61366]: X-User-Name: tempest-VolumesAdminNegativeTest-577927350-project-member Apr 18 15:27:11 user devstack@n-api.service[61366]: method: > Apr 18 15:27:11 user devstack@n-api.service[61366]: exception: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. Apr 18 15:27:11 user devstack@n-api.service[61366]: action_args: {'id': '467ddcb5-c0b8-43bd-8a39-35b35b57f0fd'} Apr 18 15:27:11 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. Apr 18 15:27:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:27:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Returning 404 to user: Instance 467ddcb5-c0b8-43bd-8a39-35b35b57f0fd could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:27:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-756ab4e9-33b7-4374-9929-385970de9646 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd" status: 404 len: 111 microversion: 2.1 time: 0.260230 Apr 18 15:27:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 99/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:11 2023] GET /compute/v2.1/servers/467ddcb5-c0b8-43bd-8a39-35b35b57f0fd => generated 111 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:27:11 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:11 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-88dfde21-98b1-45d8-bdd4-b86707552c62 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] Calling method '.version_select at 0x7fc26acd9a20>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:11 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-88dfde21-98b1-45d8-bdd4-b86707552c62 tempest-VolumesAdminNegativeTest-577927350 tempest-VolumesAdminNegativeTest-577927350-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137830134" status: 202 len: 0 microversion: 2.1 time: 0.033480 Apr 18 15:27:11 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 15:27:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137830134 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=12 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] [instance: 8947976e-1dbd-42fe-abfd-9c303bb36083] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] HTTP exception thrown: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Request method failure captured: Apr 18 15:27:12 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 HTTP/1.1 Apr 18 15:27:12 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:27:12 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:27:12 user devstack@n-api.service[61365]: Connection: close Apr 18 15:27:12 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:27:12 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:27:12 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:27:12 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:27:12 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrW4CRRSsKAlcyeMEtSscih2ycs7nBRkblsMlqPzcxI9GnmGfDMeFIWICn2javPdEAKujbaNr_HAOBPvkp6uH2rK1ZHRx3P60pZHPv1fL5k9w53t5cj0pQjcGp76vi-XRQPF136XwVKYGqGHu_Hwb_kbTtYEW2sXGCcH2t5kp7cEck8 Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Project-Id: 7fbe55073a1046539025c5b8f35c456a Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1566916014 Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7fbe55073a1046539025c5b8f35c456a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7fbe55073a1046539025c5b8f35c456a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7fbe55073a1046539025c5b8f35c456a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Tenant: tempest-ServerStableDeviceRescueTest-1566916014 Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Tenant-Id: 7fbe55073a1046539025c5b8f35c456a Apr 18 15:27:12 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1566916014 Apr 18 15:27:12 user devstack@n-api.service[61365]: X-User: tempest-ServerStableDeviceRescueTest-1566916014-project-member Apr 18 15:27:12 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:27:12 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:27:12 user devstack@n-api.service[61365]: X-User-Id: 0641255c4ab044a69d49dea48cb09f9d Apr 18 15:27:12 user devstack@n-api.service[61365]: X-User-Name: tempest-ServerStableDeviceRescueTest-1566916014-project-member Apr 18 15:27:12 user devstack@n-api.service[61365]: method: > Apr 18 15:27:12 user devstack@n-api.service[61365]: exception: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. Apr 18 15:27:12 user devstack@n-api.service[61365]: action_args: {'id': '8947976e-1dbd-42fe-abfd-9c303bb36083'} Apr 18 15:27:12 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. Apr 18 15:27:12 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:27:12 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Returning 404 to user: Instance 8947976e-1dbd-42fe-abfd-9c303bb36083 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:27:12 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fa780ccc-2e57-48ae-9252-8d5bf65dd320 tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083" status: 404 len: 111 microversion: 2.1 time: 0.043813 Apr 18 15:27:12 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 105/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:12 2023] GET /compute/v2.1/servers/8947976e-1dbd-42fe-abfd-9c303bb36083 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:27:12 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-29769d63-833a-4880-af9a-513e9338d8bb tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] Calling method '.version_select at 0x7fc26acc7010>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:12 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-29769d63-833a-4880-af9a-513e9338d8bb tempest-ServerStableDeviceRescueTest-1566916014 tempest-ServerStableDeviceRescueTest-1566916014-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419444609" status: 202 len: 0 microversion: 2.1 time: 0.020117 Apr 18 15:27:12 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 100/307] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 15:27:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419444609 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] [instance: e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:26 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] HTTP exception thrown: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Request method failure captured: Apr 18 15:27:26 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 HTTP/1.1 Apr 18 15:27:26 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:27:26 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:27:26 user devstack@n-api.service[61367]: Connection: close Apr 18 15:27:26 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:27:26 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:27:26 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:27:26 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:27:26 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrWBXR9okcTXKDlIjCuvLDFpFB6ld5EleQv6GRt6AHN6P7CZbsXeolczqz0N-c2io1LChhFF8SVpkAvAkMDuXT5UUUgdHfE17-X72wMxXFq-rMkbxxYnLcBTKg0oh0YY4wKUVgz-_zW9pKYQALsM9Nveldmf46hr-i_ZhiDoZ1RpWGE Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Project-Id: ea063b1ab78f47d7aaa62a98e71cc89d Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Project-Name: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ea063b1ab78f47d7aaa62a98e71cc89d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Tenant: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Tenant-Id: ea063b1ab78f47d7aaa62a98e71cc89d Apr 18 15:27:26 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-529089331 Apr 18 15:27:26 user devstack@n-api.service[61367]: X-User: tempest-TestMinimumBasicScenario-529089331-project-member Apr 18 15:27:26 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:27:26 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:27:26 user devstack@n-api.service[61367]: X-User-Id: ff9093e866924885b8b5cf1893f69b49 Apr 18 15:27:26 user devstack@n-api.service[61367]: X-User-Name: tempest-TestMinimumBasicScenario-529089331-project-member Apr 18 15:27:26 user devstack@n-api.service[61367]: method: > Apr 18 15:27:26 user devstack@n-api.service[61367]: exception: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. Apr 18 15:27:26 user devstack@n-api.service[61367]: action_args: {'id': 'e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4'} Apr 18 15:27:26 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. Apr 18 15:27:26 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:27:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Returning 404 to user: Instance e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:27:26 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f12a7675-22cd-4f61-b43a-6c1dd7e771b3 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4" status: 404 len: 111 microversion: 2.1 time: 0.193518 Apr 18 15:27:26 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:26 2023] GET /compute/v2.1/servers/e1112e7e-0fa8-4b68-8e9f-76cfad7f50b4 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:27:26 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a1d23be8-78c4-47c9-8acb-ae8a3c38ec53 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] Calling method '.version_select at 0x7fc26aaa32e0>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:26 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a1d23be8-78c4-47c9-8acb-ae8a3c38ec53 tempest-TestMinimumBasicScenario-529089331 tempest-TestMinimumBasicScenario-529089331-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-960140690" status: 202 len: 0 microversion: 2.1 time: 0.021490 Apr 18 15:27:26 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 106/309] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 18 15:27:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-960140690 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:31 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:32 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:32 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:32 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e6aae5e6-dad3-488a-99a5-6d0c7ebd61b0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 200 len: 1691 microversion: 2.87 time: 0.490255 Apr 18 15:27:32 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 101/310] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:27:31 2023] GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 1691 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:34 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:34 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-7575879b-137f-48e6-93ae-700598852860 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 200 len: 1544 microversion: 2.1 time: 0.288394 Apr 18 15:27:34 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:34 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:42 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fd022b06-f0f8-465c-b050-e710d23712bd tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1495 microversion: 2.1 time: 0.406708 Apr 18 15:27:42 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 107/312] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:41 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1495 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:27:44 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:27:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c567696b-5da2-40e3-9921-b47a8820cf8e tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.226813 Apr 18 15:27:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 102/313] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:27:44 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:27:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-6f83586b-7bb1-4893-a92a-40eb7685d547 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] Action: 'create', calling method: .version_select at 0x7fc26aecfac0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2015686778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLNf8NHioLE/aW2CD6nzUI8iTgir6MiI4YCECUxPD7ml2oUuo4HiT5lDny+P7RLBUIj31Un0T4dPgnZMaUqShLdnSngG93a3R1+zEPp6J3qmXlRrcgck2C4omH8+xhSlQ=="}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:27:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:27:47 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-6f83586b-7bb1-4893-a92a-40eb7685d547 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] Getting quotas for project 5a8bf34ae6914f7fb717cbd91e09d1b2. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:27:47 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-6f83586b-7bb1-4893-a92a-40eb7685d547 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] Getting quotas for user 4dd2727d2b05465e85e49e93f41a6485 and project 5a8bf34ae6914f7fb717cbd91e09d1b2. Resources: {'key_pairs'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:27:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-6f83586b-7bb1-4893-a92a-40eb7685d547 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.047107 Apr 18 15:27:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 105/314] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:27:47 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:27:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9131ef7d-4111-4c01-8102-ac9d16430040 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] Calling method '.version_select at 0x7fc26aaa36d0>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:27:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9131ef7d-4111-4c01-8102-ac9d16430040 tempest-TestVolumeBootPattern-1257460388 tempest-TestVolumeBootPattern-1257460388-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015686778" status: 202 len: 0 microversion: 2.1 time: 0.023622 Apr 18 15:27:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 108/315] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 18 15:27:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015686778 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1714726849"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-badfd944-6646-46cb-a08d-00eb0c7d70e6 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2/action" status: 202 len: 52 microversion: 2.87 time: 0.841989 Apr 18 15:28:33 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 103/316] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 15:28:32 2023] POST /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2/action => generated 52 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:35 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-509a39de-b914-4db3-ae1b-a5ad607d895e tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.215454 Apr 18 15:28:35 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 106/317] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 15:28:34 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52/os-interface => generated 282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:36 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] Creating event network-changed:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:36 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-98d3265e-b8a9-4dda-82a0-e1ccc8385842 req-ce6c115f-3ac8-40f8-b33b-b81285380259 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039758 Apr 18 15:28:36 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 109/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:36 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:36 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-3c914d0e-2d0c-4567-a179-7a3f8e905401 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52/ips" status: 200 len: 107 microversion: 2.1 time: 0.049021 Apr 18 15:28:36 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 104/319] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 15:28:36 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52/ips => generated 107 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:37 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:28:37 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-cc940f58-3e88-4e7d-836a-6e2d62fc1c27 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 204 len: 0 microversion: 2.1 time: 0.112222 Apr 18 15:28:37 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 107/320] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:28:37 2023] DELETE /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:38 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-unplugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:28:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:38 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] Creating event network-vif-unplugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:38 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-23fec26f-b32d-489c-bd6f-74b5fe454f6b req-65e271cb-76fc-4125-8193-6e61bdab633f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028881 Apr 18 15:28:38 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 105/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:28:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:38 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdecf5faa0a8407e8ee245f30d6eb607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e45db5645a54c88a6f7780012e87354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:38 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-bde2e459-e5dd-47dc-ad30-31fbd1dba569 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 200 len: 1667 microversion: 2.1 time: 0.533795 Apr 18 15:28:38 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 110/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:28:37 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 1667 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:38 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-abc9987b-3019-403d-99ce-ee1b6675937f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 200 len: 1691 microversion: 2.87 time: 0.287223 Apr 18 15:28:38 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:28:38 2023] GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 1691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:28:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-deleted", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:28:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] Creating event network-vif-deleted:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-35847132-2d0a-468a-a3bf-0f1304af57dd req-023c2c30-5c3e-423f-b1b7-24f1601d4a9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Apr 18 15:28:39 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 106/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}, {"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}, {"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}, {"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-unplugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}, {"server_uuid": "f2953604-2514-4f53-a6fe-169ff750da52", "name": "network-vif-plugged", "status": "completed", "tag": "3c10a5dc-c995-4875-9b2b-043f4817d2f7"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:28:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:40 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Creating event network-vif-unplugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] Creating event network-vif-plugged:3c10a5dc-c995-4875-9b2b-043f4817d2f7 for instance f2953604-2514-4f53-a6fe-169ff750da52 on user Apr 18 15:28:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d63cf656-47bf-40f9-8dff-3273450644f8 req-8bb734a5-a35a-414e-b735-36664bfbf394 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.074669 Apr 18 15:28:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 111/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:43 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:43 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-22a937b5-0579-44ff-8de2-e52b0cf918c1 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1495 microversion: 2.1 time: 0.214231 Apr 18 15:28:43 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 109/326] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:28:43 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1495 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:44 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-a3a919d0-f00c-4eb3-a93d-c25705f904eb tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.212191 Apr 18 15:28:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 107/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:28:44 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:44 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6ba193fe-b8f1-4d19-b0a3-c63144d64139 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.255934 Apr 18 15:28:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:28:44 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:28:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:28:45 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:28:45 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-17c3f2ab-a269-4f00-9135-2e23bea63e43 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.144679 Apr 18 15:28:45 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:28:44 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=10 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:28 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 HTTP/1.1 Apr 18 15:29:28 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:29:28 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:29:28 user devstack@n-api.service[61366]: Connection: close Apr 18 15:29:28 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:29:28 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:29:28 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:29:28 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:29:28 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:28 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:29:28 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:29:28 user devstack@n-api.service[61366]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:28 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:28 user devstack@n-api.service[61366]: method: > Apr 18 15:29:28 user devstack@n-api.service[61366]: exception: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:28 user devstack@n-api.service[61366]: action_args: {'id': 'f2953604-2514-4f53-a6fe-169ff750da52'} Apr 18 15:29:28 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:28 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-22397082-369a-4f02-a390-46b37e92e862 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 404 len: 111 microversion: 2.1 time: 0.032979 Apr 18 15:29:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 108/330] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:28 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:28 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:28 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=16 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-fe63453b-2d95-4f79-868d-88c40a4cb854 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '.version_select at 0x7fc26aaa3640>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-fe63453b-2d95-4f79-868d-88c40a4cb854 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315550948" status: 202 len: 0 microversion: 2.1 time: 0.030454 Apr 18 15:29:28 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 113/331] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:29:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315550948 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61367]: request: DELETE /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61367]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61367]: method: > Apr 18 15:29:29 user devstack@n-api.service[61367]: exception: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: action_args: {'id': 'f2953604-2514-4f53-a6fe-169ff750da52'} Apr 18 15:29:29 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-3214897a-ce89-4684-8620-35f4e1c299e4 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 404 len: 111 microversion: 2.1 time: 0.035771 Apr 18 15:29:29 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:29:29 2023] DELETE /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: f2953604-2514-4f53-a6fe-169ff750da52] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61366]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61366]: method: > Apr 18 15:29:29 user devstack@n-api.service[61366]: exception: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: action_args: {'id': 'f2953604-2514-4f53-a6fe-169ff750da52'} Apr 18 15:29:29 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance f2953604-2514-4f53-a6fe-169ff750da52 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-05e2606f-a547-440d-9567-19d88c1fa898 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52" status: 404 len: 111 microversion: 2.1 time: 0.026567 Apr 18 15:29:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 109/333] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:29 2023] GET /compute/v2.1/servers/f2953604-2514-4f53-a6fe-169ff750da52 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61365]: request: DELETE /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61365]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61365]: method: > Apr 18 15:29:29 user devstack@n-api.service[61365]: exception: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: action_args: {'id': '0af338c6-31de-4068-b172-40d4a94552a1'} Apr 18 15:29:29 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6f9e8150-1029-4603-8ece-f45ed35dfc45 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 404 len: 111 microversion: 2.1 time: 0.032392 Apr 18 15:29:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 114/334] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:29:29 2023] DELETE /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: 0af338c6-31de-4068-b172-40d4a94552a1] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61367]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61367]: method: > Apr 18 15:29:29 user devstack@n-api.service[61367]: exception: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: action_args: {'id': '0af338c6-31de-4068-b172-40d4a94552a1'} Apr 18 15:29:29 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance 0af338c6-31de-4068-b172-40d4a94552a1 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-d2c05361-f0b2-4c94-9a62-4c70edf002ff tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1" status: 404 len: 111 microversion: 2.1 time: 0.028722 Apr 18 15:29:29 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:29 2023] GET /compute/v2.1/servers/0af338c6-31de-4068-b172-40d4a94552a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61366]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61366]: method: > Apr 18 15:29:29 user devstack@n-api.service[61366]: exception: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: action_args: {'id': 'fcc0516f-559a-4d0c-aeab-56d2c08882a1'} Apr 18 15:29:29 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-72d8fc66-c079-48a3-9477-c61cb00164c5 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 404 len: 111 microversion: 2.1 time: 0.030534 Apr 18 15:29:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 110/336] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:29:29 2023] DELETE /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] [instance: fcc0516f-559a-4d0c-aeab-56d2c08882a1] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] HTTP exception thrown: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Request method failure captured: Apr 18 15:29:29 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 HTTP/1.1 Apr 18 15:29:29 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:29:29 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:29:29 user devstack@n-api.service[61365]: Connection: close Apr 18 15:29:29 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:29:29 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:29:29 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:29:29 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:29:29 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrVcNR6TRT9E77E4H2ocp81aLBK_q7AKScBZ8xBL3L--GRGny6F1kbPgB9tYyzxmQdQ34or2r3gD-9YV64BSNNoI3lO1rmQS6usMs5eB43Puo3jsNB1iruplLb9To4faMuLQ4gR6ZTROPN4_gq8YMEb0gXlf_FxXWcGfiKnTW7nP6ik Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e45db5645a54c88a6f7780012e87354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant-Id: 2e45db5645a54c88a6f7780012e87354 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1832404876 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Id: fdecf5faa0a8407e8ee245f30d6eb607 Apr 18 15:29:29 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeNegativeTest-1832404876-project-member Apr 18 15:29:29 user devstack@n-api.service[61365]: method: > Apr 18 15:29:29 user devstack@n-api.service[61365]: exception: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: action_args: {'id': 'fcc0516f-559a-4d0c-aeab-56d2c08882a1'} Apr 18 15:29:29 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. Apr 18 15:29:29 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:29:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] Returning 404 to user: Instance fcc0516f-559a-4d0c-aeab-56d2c08882a1 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-542f5666-a5f7-4020-b5b6-6d9b69c75943 tempest-AttachVolumeNegativeTest-1832404876 tempest-AttachVolumeNegativeTest-1832404876-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1" status: 404 len: 111 microversion: 2.1 time: 0.027844 Apr 18 15:29:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 115/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:29 2023] GET /compute/v2.1/servers/fcc0516f-559a-4d0c-aeab-56d2c08882a1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:38 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1675291297", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "6a2ecd63-8167-41ef-b082-40bc65b91036", "destination_type": "volume"}], "networks": [{"uuid": "6b431f75-004a-45be-9f0d-ec0a00baad53"}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:29:38 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] validate_networks() for [('6b431f75-004a-45be-9f0d-ec0a00baad53', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Getting quotas for user 7c813fea447b4ddd8d0f09078f4f173c and project f021ab0d78fb4ef1bcdceccef64bc955. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:29:39 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:29:39 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e822b131-0fa0-4c35-9bb6-4fa2d69bdeb0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.564274 Apr 18 15:29:39 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 113/338] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:29:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:29:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:39 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:39 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:29:39 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:29:39 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:29:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-cd47be64-ef4c-4bbd-85b2-9637044ef0ef tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a" status: 200 len: 1395 microversion: 2.87 time: 0.078497 Apr 18 15:29:39 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 111/339] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:29:39 2023] GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a => generated 1395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e37f30-5a4b-4e6c-a124-aacf1428ec5a", "tag": "bbae7d6f-77cc-46e7-8846-704bbb373724"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:42 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] Creating event network-changed:bbae7d6f-77cc-46e7-8846-704bbb373724 for instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a on user Apr 18 15:29:42 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-3bd44a72-77ce-44b0-81b9-192648521dbe req-37c69aa8-5a41-4bd2-a368-be201d758256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048221 Apr 18 15:29:42 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 116/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:29:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] HTTP exception thrown: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Request method failure captured: Apr 18 15:29:44 user devstack@n-api.service[61367]: request: DELETE /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 HTTP/1.1 Apr 18 15:29:44 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:29:44 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:29:44 user devstack@n-api.service[61367]: Connection: close Apr 18 15:29:44 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:29:44 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:29:44 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:29:44 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:29:44 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVfFGRoJ2sVTPVsZBZ-yP8hZOjP1LzsXuzOMffUrfz2VSu48XsrG05ldsthSvlu-cuO5Fp8cx5FzZn7ThuIpikmWD6F52EVHD81MbpQflLFuzBrzDbV8kehNMR-catQgBVHwMopVhvFhBEl0a0dBRlhalq80Ulex2vxDyZEChHHAXg Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Project-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Tenant: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Tenant-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:29:44 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61367]: X-User: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:29:44 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:29:44 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:29:44 user devstack@n-api.service[61367]: X-User-Id: 99cb7e246c95430e8324dfa9ee5dd10f Apr 18 15:29:44 user devstack@n-api.service[61367]: X-User-Name: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:29:44 user devstack@n-api.service[61367]: method: > Apr 18 15:29:44 user devstack@n-api.service[61367]: exception: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61367]: action_args: {'id': 'e51d313c-74bf-4c97-bf95-4c1dc78b65e3'} Apr 18 15:29:44 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Returning 404 to user: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e75d90fb-0c9f-492b-8b75-921a744a56cf tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 404 len: 111 microversion: 2.1 time: 0.034297 Apr 18 15:29:44 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:29:44 2023] DELETE /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: e51d313c-74bf-4c97-bf95-4c1dc78b65e3] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] HTTP exception thrown: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Request method failure captured: Apr 18 15:29:44 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 HTTP/1.1 Apr 18 15:29:44 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:29:44 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:29:44 user devstack@n-api.service[61366]: Connection: close Apr 18 15:29:44 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:29:44 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:29:44 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:29:44 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:29:44 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrVfFGRoJ2sVTPVsZBZ-yP8hZOjP1LzsXuzOMffUrfz2VSu48XsrG05ldsthSvlu-cuO5Fp8cx5FzZn7ThuIpikmWD6F52EVHD81MbpQflLFuzBrzDbV8kehNMR-catQgBVHwMopVhvFhBEl0a0dBRlhalq80Ulex2vxDyZEChHHAXg Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Project-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Tenant: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Tenant-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:29:44 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:29:44 user devstack@n-api.service[61366]: X-User: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:29:44 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:29:44 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:29:44 user devstack@n-api.service[61366]: X-User-Id: 99cb7e246c95430e8324dfa9ee5dd10f Apr 18 15:29:44 user devstack@n-api.service[61366]: X-User-Name: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:29:44 user devstack@n-api.service[61366]: method: > Apr 18 15:29:44 user devstack@n-api.service[61366]: exception: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61366]: action_args: {'id': 'e51d313c-74bf-4c97-bf95-4c1dc78b65e3'} Apr 18 15:29:44 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. Apr 18 15:29:44 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Returning 404 to user: Instance e51d313c-74bf-4c97-bf95-4c1dc78b65e3 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:29:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c1e5346d-62cd-4984-b756-7d794f355544 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3" status: 404 len: 111 microversion: 2.1 time: 0.031439 Apr 18 15:29:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 112/342] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:44 2023] GET /compute/v2.1/servers/e51d313c-74bf-4c97-bf95-4c1dc78b65e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:29:44 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2b3d3855-19bb-4a44-adff-9490d0814c2b tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 204 len: 0 microversion: 2.1 time: 0.119159 Apr 18 15:29:44 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 117/343] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:29:44 2023] DELETE /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99cb7e246c95430e8324dfa9ee5dd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf08f40b0da4ad7b2b8fdb2834d464b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:29:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-62b248ae-b7e0-48fc-b887-2e4b62dace0c tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 200 len: 1501 microversion: 2.1 time: 0.356109 Apr 18 15:29:44 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:44 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "name": "network-vif-unplugged", "status": "completed", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:44 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] Creating event network-vif-unplugged:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:29:44 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-44af0af4-ce51-428a-9b4b-4526d2db118a req-7d3dc65d-7169-49fe-9dfe-389509055847 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029935 Apr 18 15:29:44 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:29:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:29:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}, {"server_uuid": "d327a0b3-1d65-434b-bc57-ec312e17a87f", "name": "network-vif-deleted", "tag": "f7f3aa02-3332-46e8-93e4-ea7eb700add5"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:29:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:46 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Creating event network-vif-plugged:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:29:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] Creating event network-vif-deleted:f7f3aa02-3332-46e8-93e4-ea7eb700add5 for instance d327a0b3-1d65-434b-bc57-ec312e17a87f on user Apr 18 15:29:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9bc20be5-d14f-404c-9467-f7336794777c req-a89c9df6-3828-4e53-bc33-8d6450302254 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027719 Apr 18 15:29:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 118/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:29:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:46 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:29:46 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-02326de8-a7d8-4be4-995a-78e65342eb53 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.235883 Apr 18 15:29:46 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:29:46 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:29:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e37f30-5a4b-4e6c-a124-aacf1428ec5a", "name": "network-vif-deleted", "tag": "bbae7d6f-77cc-46e7-8846-704bbb373724"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:29:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:29:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:29:48 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:29:48 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.compute.server_external_events [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] Unable to find a host for instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a. Dropping event network-vif-deleted {{(pid=61366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 15:29:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-9d3d1e8f-e8a8-4602-9d94-efbf96bb8f9b req-c3d67e13-ddbc-45af-a830-19ae3843322f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036361 Apr 18 15:29:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 114/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 15:30:00 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:00 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:00 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-56a49fb7-8dbc-4d20-8ac0-aafe786a0a0a tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] Action: 'create', calling method: .version_select at 0x7fc26aaa3be0>, body: {"keypair": {"name": "tempest-TestStampPattern-707739637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtlP2edA1Mrd706tqdpvz/m0FKbv036nswvVKf7g7eID4v4Od2jpnu7/hvjtU+WxlShFRFM1vzjS3qihY7wnH7gbgN7caXfzZsiSlVPH0TF6XPUF6CTrGnh5+Ocv+xPcw=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:00 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-56a49fb7-8dbc-4d20-8ac0-aafe786a0a0a tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] Getting quotas for project e1801e328d5c496c967cdd4d8eb8e436. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:30:00 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-56a49fb7-8dbc-4d20-8ac0-aafe786a0a0a tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] Getting quotas for user 915ffadcdfff4ba395b5f50501690eef and project e1801e328d5c496c967cdd4d8eb8e436. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:30:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-56a49fb7-8dbc-4d20-8ac0-aafe786a0a0a tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.256560 Apr 18 15:30:00 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 119/349] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:30:00 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:30:03 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-fd07cf63-9124-4a2e-8823-09e7ebf01fb3 tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] Calling method '.version_select at 0x7fc26acdbf40>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:03 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:03 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:03 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:03 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=20 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:03 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-fd07cf63-9124-4a2e-8823-09e7ebf01fb3 tempest-TestStampPattern-29340972 tempest-TestStampPattern-29340972-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-707739637" status: 202 len: 0 microversion: 2.1 time: 0.031193 Apr 18 15:30:03 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 117/350] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 15:30:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-707739637 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=18 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.objects.instance [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lazy-loading 'fault' on Instance uuid 88e37f30-5a4b-4e6c-a124-aacf1428ec5a {{(pid=61366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:29 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:29 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-f9646cf5-49f4-4c2f-84f3-1aa49c31da37 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a" status: 200 len: 1650 microversion: 2.87 time: 0.123618 Apr 18 15:30:29 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 115/351] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:30:29 2023] GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a => generated 1650 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Doing local delete in cell d27f661e-81e7-4e06-bd8c-c3069818de01(cell1) {{(pid=61365) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:29 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] instance's host None is down, deleting from database Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] deallocate_for_instance() {{(pid=61365) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Instance cache missing network info. {{(pid=61365) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Updating instance_info_cache with network_info: [] {{(pid=61365) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 15:30:29 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61365) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 15:30:29 user devstack@n-api.service[61365]: WARNING nova.compute.api [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 15:30:30 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-48685c57-e233-4365-8ccf-231a6119899f tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a" status: 204 len: 0 microversion: 2.87 time: 0.386002 Apr 18 15:30:30 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 120/352] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:30:29 2023] DELETE /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 88e37f30-5a4b-4e6c-a124-aacf1428ec5a] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] HTTP exception thrown: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Request method failure captured: Apr 18 15:30:30 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a HTTP/1.1 Apr 18 15:30:30 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:30:30 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:30:30 user devstack@n-api.service[61367]: Connection: close Apr 18 15:30:30 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:30:30 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:30:30 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:30:30 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:30:30 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrWX0AuuOO2gsKnEM3hzJ9VSUy8ACp-JnjofyWiwOeB8Kmv1l5KpUCn7yWKNKnsd7LRJ6r-LthcTkNj3744LgUDS753JpgfrCinqXG9HB1QgTilBaAbq_mevS9fNJxujVpKL4ElmDuMoijGUAZEximNy_AWQ-yR7EoNoNBaLiMJR_fQ Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Project-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Tenant-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:30:30 user devstack@n-api.service[61367]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:30:30 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:30:30 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:30:30 user devstack@n-api.service[61367]: X-User-Id: 7c813fea447b4ddd8d0f09078f4f173c Apr 18 15:30:30 user devstack@n-api.service[61367]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:30:30 user devstack@n-api.service[61367]: method: > Apr 18 15:30:30 user devstack@n-api.service[61367]: exception: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. Apr 18 15:30:30 user devstack@n-api.service[61367]: action_args: {'id': '88e37f30-5a4b-4e6c-a124-aacf1428ec5a'} Apr 18 15:30:30 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. Apr 18 15:30:30 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Returning 404 to user: Instance 88e37f30-5a4b-4e6c-a124-aacf1428ec5a could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:30:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-58af1100-db49-4392-899c-fcbc3b67a503 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a" status: 404 len: 111 microversion: 2.87 time: 0.035923 Apr 18 15:30:30 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 118/353] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:30:30 2023] GET /compute/v2.1/servers/88e37f30-5a4b-4e6c-a124-aacf1428ec5a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:30:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-2ae0c248-80f3-4012-a807-31318212ebd0 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 204 len: 0 microversion: 2.87 time: 0.111401 Apr 18 15:30:30 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 116/354] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:30:30 2023] DELETE /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "name": "network-vif-unplugged", "status": "completed", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] Creating event network-vif-unplugged:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:30:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-029e0b41-732c-4382-875d-79f25281d4ee req-78366d03-32b5-4256-84d4-e544bf7e7151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029700 Apr 18 15:30:30 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:30 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:30 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-65f2451c-55e9-4c5b-83a7-714e982d18ca tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 200 len: 1697 microversion: 2.87 time: 0.311101 Apr 18 15:30:30 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 121/356] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:30:30 2023] GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 1697 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:30:32 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "name": "network-vif-plugged", "status": "completed", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}, {"server_uuid": "20c600e7-7cc9-4bd5-918e-cadf78cd56c2", "name": "network-vif-deleted", "tag": "2b6f02fb-160b-4922-80f3-b2b73bf10a89"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:32 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Creating event network-vif-plugged:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:30:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] Creating event network-vif-deleted:2b6f02fb-160b-4922-80f3-b2b73bf10a89 for instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 on user Apr 18 15:30:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-652fe8a1-71cb-498a-9abb-b900cb352fbc req-d2593861-1b89-4617-827c-324c7c7126a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029220 Apr 18 15:30:32 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] [instance: d327a0b3-1d65-434b-bc57-ec312e17a87f] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:34 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] HTTP exception thrown: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Request method failure captured: Apr 18 15:30:34 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f HTTP/1.1 Apr 18 15:30:34 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:30:34 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:30:34 user devstack@n-api.service[61367]: Connection: close Apr 18 15:30:34 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:30:34 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:30:34 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:30:34 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:30:34 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrVfFGRoJ2sVTPVsZBZ-yP8hZOjP1LzsXuzOMffUrfz2VSu48XsrG05ldsthSvlu-cuO5Fp8cx5FzZn7ThuIpikmWD6F52EVHD81MbpQflLFuzBrzDbV8kehNMR-catQgBVHwMopVhvFhBEl0a0dBRlhalq80Ulex2vxDyZEChHHAXg Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Project-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebf08f40b0da4ad7b2b8fdb2834d464b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Tenant: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Tenant-Id: ebf08f40b0da4ad7b2b8fdb2834d464b Apr 18 15:30:34 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServersNegativeTestJSON-188548537 Apr 18 15:30:34 user devstack@n-api.service[61367]: X-User: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:30:34 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:30:34 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:30:34 user devstack@n-api.service[61367]: X-User-Id: 99cb7e246c95430e8324dfa9ee5dd10f Apr 18 15:30:34 user devstack@n-api.service[61367]: X-User-Name: tempest-ServersNegativeTestJSON-188548537-project-member Apr 18 15:30:34 user devstack@n-api.service[61367]: method: > Apr 18 15:30:34 user devstack@n-api.service[61367]: exception: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. Apr 18 15:30:34 user devstack@n-api.service[61367]: action_args: {'id': 'd327a0b3-1d65-434b-bc57-ec312e17a87f'} Apr 18 15:30:34 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. Apr 18 15:30:34 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:30:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] Returning 404 to user: Instance d327a0b3-1d65-434b-bc57-ec312e17a87f could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:30:34 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-45ea51b8-7238-4c47-8330-5a93f9d4b9a4 tempest-ServersNegativeTestJSON-188548537 tempest-ServersNegativeTestJSON-188548537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f" status: 404 len: 111 microversion: 2.1 time: 0.028119 Apr 18 15:30:34 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:30:34 2023] GET /compute/v2.1/servers/d327a0b3-1d65-434b-bc57-ec312e17a87f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:30:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:45 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:46 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-90e5b308-bbd6-49eb-93c4-ff3aeeb65982 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Action: 'create', calling method: .version_select at 0x7fc26a92c940>, body: {"keypair": {"name": "tempest-keypair-1697552668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqulbs6X9zovKp4AtIt449mHw83rwvo9dW+co0/S3IQoVbV68oDXY/Sd0ItQGkTkwYUF7EnfMf+spIOKipBGhesEh/AWxJoZpkd+eStg5DfzsQ4WUNCRY6GC2L/oEetyg=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:46 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-90e5b308-bbd6-49eb-93c4-ff3aeeb65982 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:30:46 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-90e5b308-bbd6-49eb-93c4-ff3aeeb65982 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for user 4150a73c61944e97a3bf6abc1b45f096 and project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:30:46 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-90e5b308-bbd6-49eb-93c4-ff3aeeb65982 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161179 Apr 18 15:30:46 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 122/359] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 15:30:45 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:47 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-e236ee82-ad09-4e91-9c9c-32ee23ba17a9 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.335314 Apr 18 15:30:47 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 118/360] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:30:47 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1753770309", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a59dfdca-19ca-4196-b761-10cce5339ecf"}], "security_groups": [{"name": "tempest-securitygroup--2087450145"}], "key_name": "tempest-keypair-1697552668", "user_data": "}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:47 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:47 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-49087f2e-9480-4f50-97b8-0b1d7b99fe2d tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.405010 Apr 18 15:30:47 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:30:47 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:47 user devstack@n-api.service[61365]: DEBUG nova.network.neutron [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] validate_networks() for [('a59dfdca-19ca-4196-b761-10cce5339ecf', None, None, None, None, None)] {{(pid=61365) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:30:47 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:48 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c523ade6-4d31-4a75-90a0-b7006c9e174f tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.135689 Apr 18 15:30:48 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 119/362] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:30:47 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Flavor limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Image limits 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Flavor pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Image pref 0:0:0 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.virt.hardware [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61365) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for user 4150a73c61944e97a3bf6abc1b45f096 and project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'instances', 'cores', 'ram'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Going to run 1 instances... {{(pid=61365) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:30:48 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61365) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:30:48 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-2d26cf83-2c70-4889-8a90-90b94c3ce14a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.666060 Apr 18 15:30:48 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 123/363] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:30:47 2023] POST /compute/v2.1/servers => generated 400 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:30:48 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:30:48 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:30:48 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:48 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:48 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:30:48 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-efb0c83f-4032-4bc8-9c1e-772eb14a8cd9 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 200 len: 1276 microversion: 2.20 time: 0.070322 Apr 18 15:30:48 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 122/364] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:30:48 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 1276 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:30:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] Creating event network-changed:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:30:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-e1304cf5-c78d-4bce-89e4-d94eee5c0e02 req-20376d25-0248-4980-81f4-f3da3ff34619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030374 Apr 18 15:30:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 120/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:30:52 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "name": "network-vif-plugged", "status": "completed", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:52 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] Creating event network-vif-plugged:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:30:52 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-27d573ca-ea81-4b1a-af1d-5bbaf9b2d1d8 req-a1a621ea-7106-4667-a7ef-b15ba813aff1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Apr 18 15:30:52 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:30:54 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "name": "network-vif-plugged", "status": "completed", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:30:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:30:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:30:54 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:30:54 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] Creating event network-vif-plugged:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:30:54 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-9aaaa315-89ce-45ed-b4a5-8b51907f3cdf req-f1efbbee-e74f-4dcc-a80e-686c566abfbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034187 Apr 18 15:30:54 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 123/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: 20c600e7-7cc9-4bd5-918e-cadf78cd56c2] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=14 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] HTTP exception thrown: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Request method failure captured: Apr 18 15:31:20 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 HTTP/1.1 Apr 18 15:31:20 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:31:20 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:31:20 user devstack@n-api.service[61366]: Connection: close Apr 18 15:31:20 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:31:20 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:31:20 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:31:20 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:31:20 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWX0AuuOO2gsKnEM3hzJ9VSUy8ACp-JnjofyWiwOeB8Kmv1l5KpUCn7yWKNKnsd7LRJ6r-LthcTkNj3744LgUDS753JpgfrCinqXG9HB1QgTilBaAbq_mevS9fNJxujVpKL4ElmDuMoijGUAZEximNy_AWQ-yR7EoNoNBaLiMJR_fQ Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Project-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Tenant-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:31:20 user devstack@n-api.service[61366]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:31:20 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:31:20 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:31:20 user devstack@n-api.service[61366]: X-User-Id: 7c813fea447b4ddd8d0f09078f4f173c Apr 18 15:31:20 user devstack@n-api.service[61366]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:31:20 user devstack@n-api.service[61366]: method: > Apr 18 15:31:20 user devstack@n-api.service[61366]: exception: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. Apr 18 15:31:20 user devstack@n-api.service[61366]: action_args: {'id': '20c600e7-7cc9-4bd5-918e-cadf78cd56c2'} Apr 18 15:31:20 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. Apr 18 15:31:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:31:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Returning 404 to user: Instance 20c600e7-7cc9-4bd5-918e-cadf78cd56c2 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:31:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-68cddc52-9289-4e71-aaa7-45fbb7b00bd5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2" status: 404 len: 111 microversion: 2.87 time: 0.030809 Apr 18 15:31:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 121/368] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:31:20 2023] GET /compute/v2.1/servers/20c600e7-7cc9-4bd5-918e-cadf78cd56c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=10 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:21 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:31:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ef48a948-2cc8-44eb-9974-36b0f9ad3366 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 204 len: 0 microversion: 2.87 time: 0.114304 Apr 18 15:31:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 125/369] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:31:21 2023] DELETE /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "name": "network-vif-unplugged", "status": "completed", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] Creating event network-vif-unplugged:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:31:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-a6ba50c6-446d-42ae-a2e4-6262ca553573 req-e04c036d-57d7-44bf-a5e1-a5892f41eaac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030110 Apr 18 15:31:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 122/370] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:21 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c813fea447b4ddd8d0f09078f4f173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021ab0d78fb4ef1bcdceccef64bc955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:21 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-50e779fb-31fd-43db-9edd-0ab0554dd4f9 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 200 len: 1697 microversion: 2.87 time: 0.354036 Apr 18 15:31:21 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 124/371] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:31:21 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 1697 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:31:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "name": "network-vif-deleted", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:31:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:22 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] Creating event network-vif-deleted:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:31:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-2ceb7069-dfed-416e-a7cb-5cba8039bdc7 req-823164c5-4979-46b2-8a92-73ba38e63977 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Apr 18 15:31:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 126/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:31:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:31:23 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc33160-602f-4c44-9d04-3ba2938f6a37", "name": "network-vif-plugged", "status": "completed", "tag": "bc3cce22-cd59-4a67-90ea-e518e0eabf26"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:31:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] Creating event network-vif-plugged:bc3cce22-cd59-4a67-90ea-e518e0eabf26 for instance ecc33160-602f-4c44-9d04-3ba2938f6a37 on user Apr 18 15:31:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-368b35c9-cf52-4892-a373-55953978e33f req-b632a861-d9c8-40fc-993f-2dd1c0958f9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097399 Apr 18 15:31:23 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 123/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:38 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:38 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-43cd4cfa-c5b6-479a-add5-2277dface942 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 200 len: 1589 microversion: 2.20 time: 0.233186 Apr 18 15:31:38 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:31:38 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 1589 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:31:49 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:31:50 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:31:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-de01a0fd-f9b7-49d0-8b41-569596479167 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1659 microversion: 2.1 time: 0.295390 Apr 18 15:31:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 127/375] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:31:49 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1659 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] [instance: ecc33160-602f-4c44-9d04-3ba2938f6a37] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] HTTP exception thrown: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Request method failure captured: Apr 18 15:32:11 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 HTTP/1.1 Apr 18 15:32:11 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:32:11 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:32:11 user devstack@n-api.service[61366]: Connection: close Apr 18 15:32:11 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:32:11 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:32:11 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:32:11 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:32:11 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrWX0AuuOO2gsKnEM3hzJ9VSUy8ACp-JnjofyWiwOeB8Kmv1l5KpUCn7yWKNKnsd7LRJ6r-LthcTkNj3744LgUDS753JpgfrCinqXG9HB1QgTilBaAbq_mevS9fNJxujVpKL4ElmDuMoijGUAZEximNy_AWQ-yR7EoNoNBaLiMJR_fQ Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Project-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f021ab0d78fb4ef1bcdceccef64bc955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Tenant-Id: f021ab0d78fb4ef1bcdceccef64bc955 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235 Apr 18 15:32:11 user devstack@n-api.service[61366]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:32:11 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:32:11 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:32:11 user devstack@n-api.service[61366]: X-User-Id: 7c813fea447b4ddd8d0f09078f4f173c Apr 18 15:32:11 user devstack@n-api.service[61366]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member Apr 18 15:32:11 user devstack@n-api.service[61366]: method: > Apr 18 15:32:11 user devstack@n-api.service[61366]: exception: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. Apr 18 15:32:11 user devstack@n-api.service[61366]: action_args: {'id': 'ecc33160-602f-4c44-9d04-3ba2938f6a37'} Apr 18 15:32:11 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. Apr 18 15:32:11 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:32:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] Returning 404 to user: Instance ecc33160-602f-4c44-9d04-3ba2938f6a37 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:32:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-8b5fff6c-84df-4c45-a8e3-daa427cb3de5 tempest-ServerBootFromVolumeStableRescueTest-1866714235 tempest-ServerBootFromVolumeStableRescueTest-1866714235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37" status: 404 len: 111 microversion: 2.87 time: 0.036287 Apr 18 15:32:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 124/376] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:32:11 2023] GET /compute/v2.1/servers/ecc33160-602f-4c44-9d04-3ba2938f6a37 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:32:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:21 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:21 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-223498093", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:21 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] validate_networks() for [('ea53e665-2d20-4242-87aa-de620ddaa282', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Getting quotas for project 2d0d132d8ca24daebd8a61b8a5d5430b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Getting quotas for user 61c59765bfac455fb0127b6676d4b649 and project 2d0d132d8ca24daebd8a61b8a5d5430b. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:32:22 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:32:22 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-2c407240-28ee-41f8-94de-b795e5183c8b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.748275 Apr 18 15:32:22 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 126/377] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:32:21 2023] POST /compute/v2.1/servers => generated 381 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:32:22 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-28eb5c68-791d-44c4-b8fd-a84ec80d7d10 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:22 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-28eb5c68-791d-44c4-b8fd-a84ec80d7d10 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:22 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:22 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-28eb5c68-791d-44c4-b8fd-a84ec80d7d10 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:22 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-28eb5c68-791d-44c4-b8fd-a84ec80d7d10 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02" status: 200 len: 1215 microversion: 2.1 time: 0.082332 Apr 18 15:32:22 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 128/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:32:22 2023] GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:32:22 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2041159186", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:22 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:22 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:22 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] validate_networks() for [('ea53e665-2d20-4242-87aa-de620ddaa282', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Getting quotas for project 2d0d132d8ca24daebd8a61b8a5d5430b. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Getting quotas for user 61c59765bfac455fb0127b6676d4b649 and project 2d0d132d8ca24daebd8a61b8a5d5430b. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:32:23 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:32:23 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ff5b4911-61d5-48f0-a90a-e9e7d08473d7 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.708740 Apr 18 15:32:23 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 125/379] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:32:22 2023] POST /compute/v2.1/servers => generated 381 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:32:23 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-7b2c9486-ec2d-495c-839d-58c90ab491f0 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:23 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-7b2c9486-ec2d-495c-839d-58c90ab491f0 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:23 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-7b2c9486-ec2d-495c-839d-58c90ab491f0 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:23 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-7b2c9486-ec2d-495c-839d-58c90ab491f0 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 200 len: 1216 microversion: 2.1 time: 0.071133 Apr 18 15:32:23 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 127/380] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:32:23 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:32:25 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:25 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] Creating event network-changed:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:32:25 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-aabe1c75-dd98-466d-a439-d592d9e3e60b req-e4d8cc43-1d4f-4906-9246-19e1ab78d0db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093198 Apr 18 15:32:25 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 129/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:32:26 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:26 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] Creating event network-changed:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:32:26 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-206ff021-ac4a-4111-bea1-51916f157574 req-4b91b458-2a4a-459b-943b-029c63daa4bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032403 Apr 18 15:32:26 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:27 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "name": "network-vif-plugged", "status": "completed", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:27 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:27 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] Creating event network-vif-plugged:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:32:28 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-466c8570-3c05-4231-afa9-2c149a7b76c0 req-3fb27f30-cc7c-44ec-96b4-5e04c17a2060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092448 Apr 18 15:32:28 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:32:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-2e527aa1-3879-43e1-9d6d-440e263d4e38 req-12f26209-3971-497e-8c51-2dd864f130b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028590 Apr 18 15:32:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:30 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "name": "network-vif-plugged", "status": "completed", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:30 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] Creating event network-vif-plugged:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:32:30 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-f767a4cc-8f65-48cb-abbb-27b6d1bbc84a req-252715d2-af0e-4d90-bd4d-011a0fa5feeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032726 Apr 18 15:32:30 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:31 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:31 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:31 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:31 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:31 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:32:31 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-bbda35c5-d3ad-4e22-8609-bfa95b9d29c9 req-0424ae8c-0d6b-4193-ab25-5a49908cb31e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043058 Apr 18 15:32:31 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 129/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:38 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:39 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-ebf8bf5b-5d86-4d98-9876-5a965713dbf8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.242182 Apr 18 15:32:39 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 131/387] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 15:32:38 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa/os-interface => generated 283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:39 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:39 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] Creating event network-changed:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:32:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-1b71a40c-0d26-48bf-b2ed-6ae0e3db82c6 req-f6fe6bbd-2e05-42f4-ae33-02800ad29280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040227 Apr 18 15:32:40 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 128/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-a3c0559d-6cad-4c5c-9768-379918c80b76 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa/ips" status: 200 len: 111 microversion: 2.20 time: 0.057654 Apr 18 15:32:40 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 130/389] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 15:32:40 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa/ips => generated 111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:41 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:32:41 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9b242233-7b7a-4978-8d24-ead0d7cac23b tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 204 len: 0 microversion: 2.20 time: 0.115292 Apr 18 15:32:41 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 132/390] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:32:41 2023] DELETE /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:41 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:41 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "name": "network-vif-unplugged", "status": "completed", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:41 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:41 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] Creating event network-vif-unplugged:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:32:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-d7557bed-f600-4cfb-b8d0-dde74f94a166 req-06f65656-818a-4df3-87fb-c706ac201f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040291 Apr 18 15:32:42 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 131/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:42 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:42 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:42 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:42 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-d4fbf144-c80f-42f4-909c-e0be2b8031a1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 200 len: 1713 microversion: 2.20 time: 0.397407 Apr 18 15:32:42 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 129/392] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:32:41 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 1713 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:32:43 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "name": "network-vif-deleted", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:43 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] Creating event network-vif-deleted:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:32:43 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-256a6b91-ffab-4ab9-85f9-91bbd07cb474 req-4e67b341-ab4e-49fa-9daf-28437c44cd4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028523 Apr 18 15:32:43 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 133/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:44 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c0aac4f-c88e-4cef-b175-b94e7bc66dfa", "name": "network-vif-plugged", "status": "completed", "tag": "13ce0bfd-0af5-482a-b353-72b4ffaf499b"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:44 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] Creating event network-vif-plugged:13ce0bfd-0af5-482a-b353-72b4ffaf499b for instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa on user Apr 18 15:32:44 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-79c0faf4-f109-4de5-93b8-62dda1fc863a req-c0bedb60-49b5-4b53-9cba-b055a7fc40ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029881 Apr 18 15:32:44 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:50 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Going to try to terminate instance {{(pid=61366) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:32:50 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-67beff0c-8959-403f-afd8-f818f06b9b96 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 204 len: 0 microversion: 2.1 time: 0.110747 Apr 18 15:32:50 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 130/395] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:32:50 2023] DELETE /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:50 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cdce8a340441bf8777dbc42f2118ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a93c03c2c6c485fadd7209380ee7e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:32:50 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-97e55fbb-b066-4318-8504-feea8e8a83c1 tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 200 len: 1665 microversion: 2.1 time: 0.302245 Apr 18 15:32:50 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 134/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:32:50 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 1665 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:32:50 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "name": "network-vif-unplugged", "status": "completed", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:50 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] Creating event network-vif-unplugged:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:32:51 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-b6601893-d4fd-486c-80bd-fc8796f5023a req-d8ca5131-0d62-4fbd-b449-9f430c99b36b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042823 Apr 18 15:32:51 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "name": "network-vif-plugged", "status": "completed", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}, {"server_uuid": "1b7a6ca2-ec0d-44ad-b968-538f9326eef6", "name": "network-vif-deleted", "tag": "fad52f5f-def9-4abf-b12d-4b998ae041a7"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:32:53 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:32:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Creating event network-vif-plugged:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:32:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] Creating event network-vif-deleted:fad52f5f-def9-4abf-b12d-4b998ae041a7 for instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 on user Apr 18 15:32:53 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-490f1675-94da-460e-9ab2-c64413e26f57 req-9b8c7ebf-3245-4ea8-9e1d-58813e75a08a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037899 Apr 18 15:32:53 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 131/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:32:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:13 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:33:13 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-1367094c-9fd9-4523-8b19-3370ef26c50d tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 200 len: 1504 microversion: 2.1 time: 0.258220 Apr 18 15:33:13 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:33:13 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=16 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:32 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:33:32 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa HTTP/1.1 Apr 18 15:33:32 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:33:32 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:33:32 user devstack@n-api.service[61367]: Connection: close Apr 18 15:33:32 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:33:32 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:33:32 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:33:32 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:33:32 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:33:32 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:33:32 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:33:32 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:33:32 user devstack@n-api.service[61367]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:33:32 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:33:32 user devstack@n-api.service[61367]: method: > Apr 18 15:33:32 user devstack@n-api.service[61367]: exception: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:33:32 user devstack@n-api.service[61367]: action_args: {'id': '4c0aac4f-c88e-4cef-b175-b94e7bc66dfa'} Apr 18 15:33:32 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:33:32 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:33:32 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:33:32 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-952c6244-08dd-4ddb-a034-4abb43a1c929 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 404 len: 111 microversion: 2.20 time: 0.040159 Apr 18 15:33:32 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 134/400] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:33:32 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:33:32 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-73990169-7725-4934-bd41-cf41e525a9d0 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '.version_select at 0x7fc26acc7c70>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:32 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-73990169-7725-4934-bd41-cf41e525a9d0 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697552668" status: 204 len: 0 microversion: 2.20 time: 0.032170 Apr 18 15:33:32 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 132/401] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 15:33:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697552668 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:33:32 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-a4261744-7adc-42b2-a340-e50497db3a62 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Action: 'create', calling method: .version_select at 0x7fc26aa3ce50>, body: {"keypair": {"name": "tempest-keypair-2125891901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt5byqMcuHwsnQfqE39C6dRljPs6hFYq3+fl5mJyxdUT6AAETPhrZK54VLMiR5lz2RuTfS3DoqGpUBBUbmzBx4hm3IKpH8Ng+DZ/FLruWl+NZNOIwKLipiBEGUYd1UARQ=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:33:32 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:33:32 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-a4261744-7adc-42b2-a340-e50497db3a62 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:33:32 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-a4261744-7adc-42b2-a340-e50497db3a62 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for user 4150a73c61944e97a3bf6abc1b45f096 and project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:33:32 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-a4261744-7adc-42b2-a340-e50497db3a62 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.064812 Apr 18 15:33:32 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 136/402] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 15:33:32 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-887250948", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a59dfdca-19ca-4196-b761-10cce5339ecf"}], "security_groups": [{"name": "tempest-securitygroup--1547986182"}], "key_name": "tempest-keypair-2125891901", "user_data": "}} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.network.neutron [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] validate_networks() for [('a59dfdca-19ca-4196-b761-10cce5339ecf', None, None, None, None, None)] {{(pid=61367) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Flavor limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Image limits 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Flavor pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Image pref 0:0:0 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.virt.hardware [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:34 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:33:35 user devstack@n-api.service[61367]: DEBUG nova.quota [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Getting quotas for user 4150a73c61944e97a3bf6abc1b45f096 and project 01c507f731c244d2a2ee0ab8d602844c. Resources: {'instances', 'cores', 'ram'} {{(pid=61367) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:33:35 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Going to run 1 instances... {{(pid=61367) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:33:35 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:33:35 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-e17ff976-853b-483c-9f00-85813d97e4f8 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.639210 Apr 18 15:33:35 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 135/403] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 15:33:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 15:33:35 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:35 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:33:35 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:33:35 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:33:35 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:33:35 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-6e6b0d99-344d-4797-8c2d-565eb4ce22bc tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 200 len: 1275 microversion: 2.20 time: 0.074002 Apr 18 15:33:35 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 133/404] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:33:35 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 1275 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:33:37 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:33:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:37 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] Creating event network-changed:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:33:37 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-d146f6d6-41b4-42ed-9f9c-c0e500f85704 req-82444fc4-c180-41d6-adcb-0d1d7c1cbebc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030069 Apr 18 15:33:37 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 137/405] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:33:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:33:40 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "name": "network-vif-plugged", "status": "completed", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:33:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:40 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] Creating event network-vif-plugged:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:33:40 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-68cbca6a-02d0-4530-be80-fdf946cf2e31 req-31978448-ecbb-4282-9faf-2b2c6dfc9715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048812 Apr 18 15:33:40 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 136/406] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] [instance: 1b7a6ca2-ec0d-44ad-b968-538f9326eef6] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] HTTP exception thrown: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Request method failure captured: Apr 18 15:33:40 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 HTTP/1.1 Apr 18 15:33:40 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:33:40 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:33:40 user devstack@n-api.service[61366]: Connection: close Apr 18 15:33:40 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:33:40 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:33:40 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:33:40 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:33:40 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPrYMJRbbBxSlJpsNVaLrbuzCNZ8iNlt9mlggTfO_2RNjU1JdcplGz6PSvrXHwtLGD9Qyrv_Z-qFQlzoC_fRwYIc6uz7zNinbPtIBVAiKHpStfJHBJ7-SodJb855Wcwb13w8RmalhFf6VwmdQd4sxmoncV4amjFAdQLxQdVTKAxrV4vM Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Project-Id: 5a93c03c2c6c485fadd7209380ee7e3b Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Project-Name: tempest-ServerActionsTestJSON-1137619331 Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a93c03c2c6c485fadd7209380ee7e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a93c03c2c6c485fadd7209380ee7e3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a93c03c2c6c485fadd7209380ee7e3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Tenant: tempest-ServerActionsTestJSON-1137619331 Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Tenant-Id: 5a93c03c2c6c485fadd7209380ee7e3b Apr 18 15:33:40 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-ServerActionsTestJSON-1137619331 Apr 18 15:33:40 user devstack@n-api.service[61366]: X-User: tempest-ServerActionsTestJSON-1137619331-project-member Apr 18 15:33:40 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:33:40 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:33:40 user devstack@n-api.service[61366]: X-User-Id: c0cdce8a340441bf8777dbc42f2118ca Apr 18 15:33:40 user devstack@n-api.service[61366]: X-User-Name: tempest-ServerActionsTestJSON-1137619331-project-member Apr 18 15:33:40 user devstack@n-api.service[61366]: method: > Apr 18 15:33:40 user devstack@n-api.service[61366]: exception: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. Apr 18 15:33:40 user devstack@n-api.service[61366]: action_args: {'id': '1b7a6ca2-ec0d-44ad-b968-538f9326eef6'} Apr 18 15:33:40 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. Apr 18 15:33:40 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:33:40 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Returning 404 to user: Instance 1b7a6ca2-ec0d-44ad-b968-538f9326eef6 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:33:40 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-96683b37-0a27-4d23-bf1f-cb6d3a8e431b tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6" status: 404 len: 111 microversion: 2.1 time: 0.032390 Apr 18 15:33:40 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 134/407] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:33:40 2023] GET /compute/v2.1/servers/1b7a6ca2-ec0d-44ad-b968-538f9326eef6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:33:40 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-14013ca9-4816-4070-aa91-3eea0dcf7eae tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] Calling method '.version_select at 0x7fc26aa3cd30>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:33:40 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-14013ca9-4816-4070-aa91-3eea0dcf7eae tempest-ServerActionsTestJSON-1137619331 tempest-ServerActionsTestJSON-1137619331-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780748071" status: 202 len: 0 microversion: 2.1 time: 0.022402 Apr 18 15:33:40 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 15:33:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780748071 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 15:33:42 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "name": "network-vif-plugged", "status": "completed", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:33:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:33:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:33:42 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:33:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] Creating event network-vif-plugged:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:33:42 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-797bc698-2fdd-4ea8-a258-38e7d912a04f req-c7159869-c6df-48dc-8494-1956463d563d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041037 Apr 18 15:33:42 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:13 user devstack@n-api.service[61366]: DEBUG nova.objects.instance [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lazy-loading 'flavor' on Instance uuid 3ec98332-88cb-456d-b41d-6e64130de41a {{(pid=61366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 15:34:13 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-ba24ff07-d6d3-4dd8-9999-60e716e7df6e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a/action" status: 200 len: 32 microversion: 2.1 time: 0.154384 Apr 18 15:34:13 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 135/410] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 15:34:13 2023] POST /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:13 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:14 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:34:14 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6572edef-4810-4780-9cf9-d3021265ad22 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 200 len: 1510 microversion: 2.1 time: 0.456371 Apr 18 15:34:14 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:34:13 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=8 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-unplugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:14 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:14 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] Creating event network-vif-unplugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:34:14 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-c3fb2195-dbd6-4ee7-b25d-308fe23e5395 req-ce7b70de-1cc8-4d59-8c49-a000685d4c10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043352 Apr 18 15:34:14 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:34:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:34:16 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:34:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:16 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:16 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:34:17 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-430fe5b6-9b3a-483e-b1d2-36c7f91c8b6c req-37b57053-d0c6-4b52-b41a-71c5f517564d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043061 Apr 18 15:34:17 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 136/413] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:34:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:34:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}, {"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:34:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:34:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:34:19 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-80f109ee-8d92-43bd-84ca-a277358e1a06 req-60866941-b8e7-4133-aa76-127934ea2c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027955 Apr 18 15:34:19 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 140/414] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:34:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:34:25 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:34:25 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-9b59d6a1-9ed7-481b-a4b1-9847cdc1180f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 200 len: 1588 microversion: 2.20 time: 0.213298 Apr 18 15:34:25 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 139/415] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:34:25 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 1588 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:04 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:35:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c65575c9-1919-47a9-ba67-6bb3c06c02ea tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 200 len: 1490 microversion: 2.1 time: 0.220412 Apr 18 15:35:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 137/416] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:35:04 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 1490 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=8 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:25 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:25 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-5849cdef-0d02-43d0-aef6-e1be675d7927 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.158437 Apr 18 15:35:25 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 141/417] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 15:35:25 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66/os-interface => generated 283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:26 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:26 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] Creating event network-changed:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:35:26 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-b34c33d6-88ab-4300-9249-422b4a89150c req-61b9be93-b468-4aa3-8d46-b12995133a12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038594 Apr 18 15:35:26 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 140/418] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:35:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:26 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:26 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-255ee934-c901-46f3-ad44-1827dcb53a0c tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66/ips" status: 200 len: 111 microversion: 2.20 time: 0.038565 Apr 18 15:35:26 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 138/419] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 15:35:26 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66/ips => generated 111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:28 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:35:28 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-38407cad-0092-4c63-b30b-68d519df2552 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 204 len: 0 microversion: 2.20 time: 0.115385 Apr 18 15:35:28 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 142/420] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:35:28 2023] DELETE /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:35:28 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4150a73c61944e97a3bf6abc1b45f096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c507f731c244d2a2ee0ab8d602844c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:35:28 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-fc4565eb-986e-4465-884d-1bc1e89b865f tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 200 len: 1711 microversion: 2.20 time: 0.276921 Apr 18 15:35:28 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 141/421] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:35:28 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 1711 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 15:35:28 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "name": "network-vif-unplugged", "status": "completed", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:35:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] Creating event network-vif-unplugged:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:35:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-4e2f8045-4bd0-4cbf-806d-d84cde788368 req-8dc2f308-947a-4c9a-9294-49a55459c8f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032187 Apr 18 15:35:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 139/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:35:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:35:29 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "name": "network-vif-deleted", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:35:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:29 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] Creating event network-vif-deleted:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:35:29 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-47fe6441-5ffd-429a-afbf-06544291adad req-685e11dc-1b3e-4c60-9233-b16d755786b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030438 Apr 18 15:35:29 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 143/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:35:30 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9a6558c-5a67-4081-a7aa-312b327c8b66", "name": "network-vif-plugged", "status": "completed", "tag": "61750790-b36b-4b41-9bc4-0d7e462a7a48"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:35:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:35:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:35:30 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:35:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] Creating event network-vif-plugged:61750790-b36b-4b41-9bc4-0d7e462a7a48 for instance c9a6558c-5a67-4081-a7aa-312b327c8b66 on user Apr 18 15:35:30 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-52948c79-f50e-4d88-a98f-26925eea187f req-f90d8694-1bdd-4b34-899d-570bc462d2e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029282 Apr 18 15:35:30 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:04 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:36:04 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-687daaa1-2b5b-4a9a-a6d4-f9abb06dccfc tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02" status: 200 len: 1503 microversion: 2.1 time: 0.239109 Apr 18 15:36:04 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:36:04 2023] GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:36:18 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 HTTP/1.1 Apr 18 15:36:18 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:36:18 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:36:18 user devstack@n-api.service[61365]: Connection: close Apr 18 15:36:18 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:36:18 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:36:18 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:36:18 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:36:18 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:18 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:18 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:36:18 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:36:18 user devstack@n-api.service[61365]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:36:18 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:18 user devstack@n-api.service[61365]: method: > Apr 18 15:36:18 user devstack@n-api.service[61365]: exception: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:18 user devstack@n-api.service[61365]: action_args: {'id': 'c9a6558c-5a67-4081-a7aa-312b327c8b66'} Apr 18 15:36:18 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:18 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:36:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-bec88416-d316-48fe-80cd-ed8fbe649fdd tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 404 len: 111 microversion: 2.20 time: 0.246519 Apr 18 15:36:18 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 144/426] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:36:18 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:36:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:18 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=10 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:18 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-060f12d1-a280-455a-9b43-91aa28692d87 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '.version_select at 0x7fc26acd8820>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:18 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-060f12d1-a280-455a-9b43-91aa28692d87 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125891901" status: 204 len: 0 microversion: 2.20 time: 0.029819 Apr 18 15:36:18 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 143/427] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 15:36:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2125891901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:36:19 user devstack@n-api.service[61366]: request: DELETE /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 HTTP/1.1 Apr 18 15:36:19 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:36:19 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:36:19 user devstack@n-api.service[61366]: Connection: close Apr 18 15:36:19 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:36:19 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:36:19 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:36:19 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:36:19 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:19 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:19 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:36:19 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:36:19 user devstack@n-api.service[61366]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:36:19 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:19 user devstack@n-api.service[61366]: method: > Apr 18 15:36:19 user devstack@n-api.service[61366]: exception: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:19 user devstack@n-api.service[61366]: action_args: {'id': 'c9a6558c-5a67-4081-a7aa-312b327c8b66'} Apr 18 15:36:19 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:19 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:19 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:36:19 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-5230b825-9ac7-4804-907b-fa13a306f953 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 404 len: 111 microversion: 2.20 time: 0.030078 Apr 18 15:36:19 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 141/428] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:36:19 2023] DELETE /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: c9a6558c-5a67-4081-a7aa-312b327c8b66] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:19 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:36:20 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 HTTP/1.1 Apr 18 15:36:20 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:36:20 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:36:20 user devstack@n-api.service[61365]: Connection: close Apr 18 15:36:20 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:36:20 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:36:20 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:36:20 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:36:20 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61365]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:36:20 user devstack@n-api.service[61365]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61365]: method: > Apr 18 15:36:20 user devstack@n-api.service[61365]: exception: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:20 user devstack@n-api.service[61365]: action_args: {'id': 'c9a6558c-5a67-4081-a7aa-312b327c8b66'} Apr 18 15:36:20 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. Apr 18 15:36:20 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance c9a6558c-5a67-4081-a7aa-312b327c8b66 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:36:20 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-18b19dd5-b5ea-438d-b5ea-974c2e77d8c1 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66" status: 404 len: 111 microversion: 2.20 time: 0.028342 Apr 18 15:36:20 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 145/429] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:36:19 2023] GET /compute/v2.1/servers/c9a6558c-5a67-4081-a7aa-312b327c8b66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:36:20 user devstack@n-api.service[61367]: request: DELETE /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa HTTP/1.1 Apr 18 15:36:20 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:36:20 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:36:20 user devstack@n-api.service[61367]: Connection: close Apr 18 15:36:20 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:36:20 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:36:20 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:36:20 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:36:20 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61367]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:36:20 user devstack@n-api.service[61367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61367]: method: > Apr 18 15:36:20 user devstack@n-api.service[61367]: exception: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61367]: action_args: {'id': '4c0aac4f-c88e-4cef-b175-b94e7bc66dfa'} Apr 18 15:36:20 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:36:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-eec7d677-55c2-4f1d-81d1-7a9a31848e14 tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 404 len: 111 microversion: 2.20 time: 0.026975 Apr 18 15:36:20 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 144/430] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 15:36:20 2023] DELETE /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] [instance: 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:36:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.wsgi [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] HTTP exception thrown: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Request method failure captured: Apr 18 15:36:20 user devstack@n-api.service[61366]: request: GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa HTTP/1.1 Apr 18 15:36:20 user devstack@n-api.service[61366]: Accept: application/json Apr 18 15:36:20 user devstack@n-api.service[61366]: Accept-Encoding: identity Apr 18 15:36:20 user devstack@n-api.service[61366]: Connection: close Apr 18 15:36:20 user devstack@n-api.service[61366]: Content-Length: 0 Apr 18 15:36:20 user devstack@n-api.service[61366]: Content-Type: application/json Apr 18 15:36:20 user devstack@n-api.service[61366]: Host: 10.0.0.210 Apr 18 15:36:20 user devstack@n-api.service[61366]: Openstack-System-Scope: None Apr 18 15:36:20 user devstack@n-api.service[61366]: User-Agent: python-urllib3/1.26.15 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Auth-Token: gAAAAABkPreloO8Souwp_7fwM_OB42_BTLfBoVqbVGbDBiupVlyFr3H7C_Izd4geDX9BLcks6tn5ewuKpu5bLTfBQpGvpSmHoBWezUR331sPfidS_QopPsDKi8AxhcHmuz407CkbF3QtQOEmo1dgLEbyQm5R8ck2jt27AVfGCxZsy9gP2wA6jBA Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Domain-Id: None Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Domain-Name: None Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Identity-Status: Confirmed Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Is-Admin-Project: True Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Project-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Project-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Project-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Role: member,reader Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Roles: member,reader Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01c507f731c244d2a2ee0ab8d602844c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Tenant-Id: 01c507f731c244d2a2ee0ab8d602844c Apr 18 15:36:20 user devstack@n-api.service[61366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1485500833 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-User: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61366]: X-User-Domain-Id: default Apr 18 15:36:20 user devstack@n-api.service[61366]: X-User-Domain-Name: Default Apr 18 15:36:20 user devstack@n-api.service[61366]: X-User-Id: 4150a73c61944e97a3bf6abc1b45f096 Apr 18 15:36:20 user devstack@n-api.service[61366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1485500833-project-member Apr 18 15:36:20 user devstack@n-api.service[61366]: method: > Apr 18 15:36:20 user devstack@n-api.service[61366]: exception: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61366]: action_args: {'id': '4c0aac4f-c88e-4cef-b175-b94e7bc66dfa'} Apr 18 15:36:20 user devstack@n-api.service[61366]: {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. Apr 18 15:36:20 user devstack@n-api.service[61366]: ERROR nova.api.openstack.wsgi Apr 18 15:36:20 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] Returning 404 to user: Instance 4c0aac4f-c88e-4cef-b175-b94e7bc66dfa could not be found. {{(pid=61366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:36:20 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-98f92188-fbc4-43f7-ad91-8d2f558db96a tempest-AttachVolumeShelveTestJSON-1485500833 tempest-AttachVolumeShelveTestJSON-1485500833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa" status: 404 len: 111 microversion: 2.20 time: 0.034548 Apr 18 15:36:20 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 142/431] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 15:36:20 2023] GET /compute/v2.1/servers/4c0aac4f-c88e-4cef-b175-b94e7bc66dfa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 15:37:08 user devstack@n-api.service[61365]: Tue Apr 18 15:37:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a (ip 10.0.0.210) !!! Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:08 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:37:08 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6894d4a0-357c-4677-a6b7-4dc36acd072f tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 204 len: 0 microversion: 2.1 time: 0.121743 Apr 18 15:37:08 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 146/432] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:37:08 2023] DELETE /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-unplugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:08 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] Creating event network-vif-unplugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:37:08 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-af0845ed-0f71-42f2-b58d-0d62239a3b9b req-d9d4c27c-f98b-440e-9e97-2ad2c0867a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034366 Apr 18 15:37:08 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 143/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:37:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:37:08 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:37:08 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-3efd02cb-65ec-435f-9363-ae85be0bad95 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 200 len: 1496 microversion: 2.1 time: 0.589354 Apr 18 15:37:08 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:37:08 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 1496 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:37:09 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-deleted", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:37:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:09 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] Creating event network-vif-deleted:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:37:09 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9ff9055d-510e-449f-8165-b08c6bcef927 req-1a3042c6-5ccf-40a3-8535-15d40a5d01cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134089 Apr 18 15:37:09 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 147/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:37:10 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ec98332-88cb-456d-b41d-6e64130de41a", "name": "network-vif-plugged", "status": "completed", "tag": "a43d5fdf-48c7-463e-a465-7b32bdb50095"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:37:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:10 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:10 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] Creating event network-vif-plugged:a43d5fdf-48c7-463e-a465-7b32bdb50095 for instance 3ec98332-88cb-456d-b41d-6e64130de41a on user Apr 18 15:37:10 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-7fddebe5-238d-40d7-ba94-7a890258cdc5 req-28c8bad4-941f-4cbd-ba02-eedf32bde2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034079 Apr 18 15:37:10 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 144/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:37:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 3ec98332-88cb-456d-b41d-6e64130de41a] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:58 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] HTTP exception thrown: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Request method failure captured: Apr 18 15:37:59 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a HTTP/1.1 Apr 18 15:37:59 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:37:59 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:37:59 user devstack@n-api.service[61367]: Connection: close Apr 18 15:37:59 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:37:59 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:37:59 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:37:59 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:37:59 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrgF8NZ7ACV9a-UZ29vrRC3MmNCrOQHeLb0kKxphZOl7iTkGB3g-_eGG0rKt4aUiBzAdjL9FclYzZ3ZCNKgJJRiGpyd690IsT8Hgz2LdhaUlC4-wXsT0156CwXWUdtzwrWqDomEHQxSmBQq4n7hP840tIUsszjrDrGDoV5N9X6zfUNw Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Project-Id: 2d0d132d8ca24daebd8a61b8a5d5430b Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Tenant-Id: 2d0d132d8ca24daebd8a61b8a5d5430b Apr 18 15:37:59 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:37:59 user devstack@n-api.service[61367]: X-User: tempest-ServerRescueNegativeTestJSON-498072548-project-member Apr 18 15:37:59 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:37:59 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:37:59 user devstack@n-api.service[61367]: X-User-Id: 61c59765bfac455fb0127b6676d4b649 Apr 18 15:37:59 user devstack@n-api.service[61367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-498072548-project-member Apr 18 15:37:59 user devstack@n-api.service[61367]: method: > Apr 18 15:37:59 user devstack@n-api.service[61367]: exception: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. Apr 18 15:37:59 user devstack@n-api.service[61367]: action_args: {'id': '3ec98332-88cb-456d-b41d-6e64130de41a'} Apr 18 15:37:59 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. Apr 18 15:37:59 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Returning 404 to user: Instance 3ec98332-88cb-456d-b41d-6e64130de41a could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:37:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-209ebba4-4bd3-4571-859a-3aaaa064b987 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a" status: 404 len: 111 microversion: 2.1 time: 0.163582 Apr 18 15:37:59 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:37:58 2023] GET /compute/v2.1/servers/3ec98332-88cb-456d-b41d-6e64130de41a => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:59 user devstack@n-api.service[61365]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 15:37:59 user devstack@n-api.service[61365]: Tue Apr 18 15:37:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 (ip 10.0.0.210) !!! Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Going to try to terminate instance {{(pid=61365) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:37:59 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-6dc7e10c-43c4-413b-9acb-525c21a7726e tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02" status: 204 len: 0 microversion: 2.1 time: 0.138334 Apr 18 15:37:59 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:37:59 2023] DELETE /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "name": "network-vif-unplugged", "status": "completed", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:37:59 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c59765bfac455fb0127b6676d4b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0d132d8ca24daebd8a61b8a5d5430b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:37:59 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-7ad3c0f4-d901-4678-8dc3-4730a0959de1 tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02" status: 200 len: 1509 microversion: 2.1 time: 0.310016 Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:37:59 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:37:59 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 145/439] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:37:59 2023] GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 15:37:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] Creating event network-vif-unplugged:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:37:59 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-8eb25068-ca2e-4b93-984d-b8b6688096c0 req-4726c82d-7fa7-40fb-9fec-cfd3e9874af4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094814 Apr 18 15:37:59 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 147/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:37:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:38:00 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "name": "network-vif-deleted", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:38:00 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:38:00 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:38:00 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:38:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] Creating event network-vif-deleted:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:38:00 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-9bfda596-a531-4161-a36a-5a12af949d10 req-302c3dc6-5b5e-4d15-b46e-bfb3a269072f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 Apr 18 15:38:00 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 149/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:38:01 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9575aa6b-4e96-4c5c-9ebf-6f16f4535f02", "name": "network-vif-plugged", "status": "completed", "tag": "54f13a84-8543-4511-9d81-4057224c9c33"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:38:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:38:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:38:01 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:38:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] Creating event network-vif-plugged:54f13a84-8543-4511-9d81-4057224c9c33 for instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 on user Apr 18 15:38:01 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-c29fd514-deca-468a-a968-1459e7c66e1a req-411133e6-8e0a-491e-aa6b-726d211ee1bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027958 Apr 18 15:38:01 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 146/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=4 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] [instance: 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:38:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.wsgi [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] HTTP exception thrown: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Request method failure captured: Apr 18 15:38:49 user devstack@n-api.service[61367]: request: GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 HTTP/1.1 Apr 18 15:38:49 user devstack@n-api.service[61367]: Accept: application/json Apr 18 15:38:49 user devstack@n-api.service[61367]: Accept-Encoding: identity Apr 18 15:38:49 user devstack@n-api.service[61367]: Connection: close Apr 18 15:38:49 user devstack@n-api.service[61367]: Content-Length: 0 Apr 18 15:38:49 user devstack@n-api.service[61367]: Content-Type: application/json Apr 18 15:38:49 user devstack@n-api.service[61367]: Host: 10.0.0.210 Apr 18 15:38:49 user devstack@n-api.service[61367]: Openstack-System-Scope: None Apr 18 15:38:49 user devstack@n-api.service[61367]: User-Agent: python-urllib3/1.26.15 Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Auth-Token: gAAAAABkPrgF8NZ7ACV9a-UZ29vrRC3MmNCrOQHeLb0kKxphZOl7iTkGB3g-_eGG0rKt4aUiBzAdjL9FclYzZ3ZCNKgJJRiGpyd690IsT8Hgz2LdhaUlC4-wXsT0156CwXWUdtzwrWqDomEHQxSmBQq4n7hP840tIUsszjrDrGDoV5N9X6zfUNw Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Domain-Id: None Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Domain-Name: None Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Identity-Status: Confirmed Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Is-Admin-Project: True Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Project-Domain-Id: default Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Project-Domain-Name: Default Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Project-Id: 2d0d132d8ca24daebd8a61b8a5d5430b Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Role: member,reader Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Roles: member,reader Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d0d132d8ca24daebd8a61b8a5d5430b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Tenant-Id: 2d0d132d8ca24daebd8a61b8a5d5430b Apr 18 15:38:49 user devstack@n-api.service[61367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-498072548 Apr 18 15:38:49 user devstack@n-api.service[61367]: X-User: tempest-ServerRescueNegativeTestJSON-498072548-project-member Apr 18 15:38:49 user devstack@n-api.service[61367]: X-User-Domain-Id: default Apr 18 15:38:49 user devstack@n-api.service[61367]: X-User-Domain-Name: Default Apr 18 15:38:49 user devstack@n-api.service[61367]: X-User-Id: 61c59765bfac455fb0127b6676d4b649 Apr 18 15:38:49 user devstack@n-api.service[61367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-498072548-project-member Apr 18 15:38:49 user devstack@n-api.service[61367]: method: > Apr 18 15:38:49 user devstack@n-api.service[61367]: exception: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. Apr 18 15:38:49 user devstack@n-api.service[61367]: action_args: {'id': '9575aa6b-4e96-4c5c-9ebf-6f16f4535f02'} Apr 18 15:38:49 user devstack@n-api.service[61367]: {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. Apr 18 15:38:49 user devstack@n-api.service[61367]: ERROR nova.api.openstack.wsgi Apr 18 15:38:49 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] Returning 404 to user: Instance 9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 could not be found. {{(pid=61367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:38:49 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-f1c95886-e989-4ea4-9524-069a43747e6b tempest-ServerRescueNegativeTestJSON-498072548 tempest-ServerRescueNegativeTestJSON-498072548-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02" status: 404 len: 111 microversion: 2.1 time: 0.035127 Apr 18 15:38:49 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 148/443] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:38:49 2023] GET /compute/v2.1/servers/9575aa6b-4e96-4c5c-9ebf-6f16f4535f02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:39:25 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:25 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:26 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-d6e0eece-c969-45cc-a9dd-c381ffe97fa1 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Action: 'create', calling method: .version_select at 0x7fc26a92f010>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1336579351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc5hqmb3j6iwPGcesRZcoNZAc0Cm5YP0jOjd2suj7q0dhF0D4f5tvICug/fozfch0de5uW9BKrRJ4ZFzTgIno5wFXnbcIbnKJamAcEeidT/+KUit/XApZ9KF+bZuEZDHQ=="}} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:39:26 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-d6e0eece-c969-45cc-a9dd-c381ffe97fa1 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Getting quotas for project e806beceabfc4663a407d971dd3d3aa4. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:39:26 user devstack@n-api.service[61365]: DEBUG nova.quota [None req-d6e0eece-c969-45cc-a9dd-c381ffe97fa1 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Getting quotas for user 2637a7dde15b4c48850e6eab7bb0eed9 and project e806beceabfc4663a407d971dd3d3aa4. Resources: {'key_pairs'} {{(pid=61365) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:39:26 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-d6e0eece-c969-45cc-a9dd-c381ffe97fa1 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.291815 Apr 18 15:39:26 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 150/444] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 15:39:25 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:27 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 15:39:27 user devstack@n-api.service[61366]: Tue Apr 18 15:39:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1263285735", "imageRef": "6a2ecd63-8167-41ef-b082-40bc65b91036", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1336579351", "security_groups": [{"name": "tempest-secgroup-smoke-1559991489"}], "networks": [{"uuid": "d05f2d17-652f-40c2-87ef-dc5177853fa3"}]}} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.network.neutron [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] validate_networks() for [('d05f2d17-652f-40c2-87ef-dc5177853fa3', None, None, None, None, None)] {{(pid=61366) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Flavor limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Image limits 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Flavor pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Image pref 0:0:0 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 15:39:27 user devstack@n-api.service[61366]: DEBUG nova.virt.hardware [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Getting quotas for project e806beceabfc4663a407d971dd3d3aa4. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG nova.quota [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Getting quotas for user 2637a7dde15b4c48850e6eab7bb0eed9 and project e806beceabfc4663a407d971dd3d3aa4. Resources: {'instances', 'cores', 'ram'} {{(pid=61366) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Going to run 1 instances... {{(pid=61366) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 15:39:28 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6a2ecd63-8167-41ef-b082-40bc65b91036',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 15:39:28 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-604ea779-e0f5-453f-9750-c0d68295c7ce tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.752672 Apr 18 15:39:28 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 147/445] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 15:39:27 2023] POST /compute/v2.1/servers => generated 404 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 15:39:28 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-28f754d2-7abd-4035-9e06-2d2a1c884756 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:39:28 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-28f754d2-7abd-4035-9e06-2d2a1c884756 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:39:28 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:28 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:39:28 user devstack@n-api.service[61367]: DEBUG nova.policy [None req-28f754d2-7abd-4035-9e06-2d2a1c884756 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637a7dde15b4c48850e6eab7bb0eed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e806beceabfc4663a407d971dd3d3aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61367) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:39:28 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-28f754d2-7abd-4035-9e06-2d2a1c884756 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 200 len: 1257 microversion: 2.1 time: 0.079782 Apr 18 15:39:28 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:39:28 2023] GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 1257 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:39:31 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}]} {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:39:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:39:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:39:31 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:39:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.compute.server_external_events [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] Creating event network-changed:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:39:31 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [req-4fc36fe1-9102-42d0-bb93-98c3188e1d8d req-de948421-1ebe-46d5-8c93-65ee45ac7b84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029051 Apr 18 15:39:31 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:39:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:39:33 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "name": "network-vif-plugged", "status": "completed", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:39:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:39:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:39:33 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:39:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] Creating event network-vif-plugged:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:39:33 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-207703f3-6fb1-452a-8a05-057dff4c1179 req-a2bf5e63-1739-4e59-80ee-889412a0a9d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041507 Apr 18 15:39:33 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 148/448] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:39:35 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "name": "network-vif-plugged", "status": "completed", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:39:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:39:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:39:35 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:39:35 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] Creating event network-vif-plugged:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:39:35 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-9b2c0196-46f2-49ba-8b06-b3a4626850e3 req-baa583a7-fa31-4cd7-b263-818d10181d98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 Apr 18 15:39:35 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell0:SELECT=4 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:40:18 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637a7dde15b4c48850e6eab7bb0eed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e806beceabfc4663a407d971dd3d3aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:40:18 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-3dcc1507-7591-440e-8dd4-7faaea25645c tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 200 len: 1568 microversion: 2.1 time: 0.372688 Apr 18 15:40:18 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:40:18 2023] GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 1568 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=2 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell0:SELECT=6 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG nova.compute.api [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61366) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:18 user devstack@n-api.service[61366]: DEBUG nova.policy [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637a7dde15b4c48850e6eab7bb0eed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e806beceabfc4663a407d971dd3d3aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61366) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:41:18 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-c013c4f1-3ac7-4c23-becb-eed99f5017df tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 200 len: 1568 microversion: 2.1 time: 0.259410 Apr 18 15:41:18 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 149/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:41:18 2023] GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell0:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:20 user devstack@n-api.service[61367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 15:41:20 user devstack@n-api.service[61367]: Tue Apr 18 15:41:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 (ip 10.0.0.210) !!! Apr 18 15:41:20 user devstack@n-api.service[61367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 15:41:20 user devstack@n-api.service[61367]: Tue Apr 18 15:41:20 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 (ip 10.0.0.210) !!! Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_api:SELECT=6 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG dbcounter [-] [61367] Writing DB stats nova_cell1:SELECT=2 {{(pid=61367) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61367) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:20 user devstack@n-api.service[61367]: DEBUG nova.compute.api [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Going to try to terminate instance {{(pid=61367) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 15:41:20 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [None req-540b6d81-4a09-45a7-9b88-d61786838eff tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 204 len: 0 microversion: 2.1 time: 0.133824 Apr 18 15:41:20 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 15:41:20 2023] DELETE /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:20 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:21 user devstack@n-api.service[61365]: DEBUG nova.policy [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2637a7dde15b4c48850e6eab7bb0eed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e806beceabfc4663a407d971dd3d3aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61365) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 15:41:21 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-f5d0de45-37c8-47ba-bdaf-f32589751fd2 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 200 len: 1574 microversion: 2.1 time: 0.299202 Apr 18 15:41:21 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:41:20 2023] GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 1574 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 15:41:21 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "name": "network-vif-unplugged", "status": "completed", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}]} {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:21 user devstack@n-api.service[61366]: DEBUG oslo_concurrency.lockutils [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61366) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.compute.server_external_events [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] Creating event network-vif-unplugged:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:41:21 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [req-d0321be2-df04-42de-a88d-39153b2c7fc1 req-9ab621a7-b0a3-4434-8ce6-b555dc615896 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031493 Apr 18 15:41:21 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 150/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:41:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:41:23 user devstack@n-api.service[61367]: DEBUG nova.api.openstack.wsgi [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "name": "network-vif-plugged", "status": "completed", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}, {"server_uuid": "2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29", "name": "network-vif-deleted", "tag": "34850ecb-b9cf-438e-b104-6f258e21266a"}]} {{(pid=61367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 15:41:23 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:41:23 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:41:23 user devstack@n-api.service[61367]: DEBUG oslo_concurrency.lockutils [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61367) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:41:23 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Creating event network-vif-plugged:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:41:23 user devstack@n-api.service[61367]: INFO nova.api.openstack.compute.server_external_events [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] Creating event network-vif-deleted:34850ecb-b9cf-438e-b104-6f258e21266a for instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 on user Apr 18 15:41:23 user devstack@n-api.service[61367]: INFO nova.api.openstack.requestlog [req-7624d131-bd80-4d13-815b-10535c865a31 req-73baffcf-40a4-4c5b-a197-3076f5559de7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029135 Apr 18 15:41:23 user devstack@n-api.service[61367]: [pid: 61367|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 15:41:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '>' {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG nova.compute.api [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] [instance: 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29] Fetching instance by UUID {{(pid=61365) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_api:SELECT=2 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG dbcounter [-] [61365] Writing DB stats nova_cell1:SELECT=6 {{(pid=61365) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Acquiring lock "d27f661e-81e7-4e06-bd8c-c3069818de01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG oslo_concurrency.lockutils [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Lock "d27f661e-81e7-4e06-bd8c-c3069818de01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61365) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 15:42:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.wsgi [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] HTTP exception thrown: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Request method failure captured: Apr 18 15:42:11 user devstack@n-api.service[61365]: request: GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 HTTP/1.1 Apr 18 15:42:11 user devstack@n-api.service[61365]: Accept: application/json Apr 18 15:42:11 user devstack@n-api.service[61365]: Accept-Encoding: identity Apr 18 15:42:11 user devstack@n-api.service[61365]: Connection: close Apr 18 15:42:11 user devstack@n-api.service[61365]: Content-Length: 0 Apr 18 15:42:11 user devstack@n-api.service[61365]: Content-Type: application/json Apr 18 15:42:11 user devstack@n-api.service[61365]: Host: 10.0.0.210 Apr 18 15:42:11 user devstack@n-api.service[61365]: Openstack-System-Scope: None Apr 18 15:42:11 user devstack@n-api.service[61365]: User-Agent: python-urllib3/1.26.15 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Auth-Token: gAAAAABkPrmntOwYs1HkOW0HKo2qxcG1FCXnq6jaw7H4suNCmrI5vi0vMtVAwzwvSUZDsklFzb1xMODs2Hahf5bTIPyAkFK0OuJm_kUM18RJZZe-t2ag8hZLEhknDxmhxhB2wCmwcNL6yZ6VMIh-1rdTSWmC-Zikcx4-A6bOXVMrngMzftl4SKM Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Domain-Id: None Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Domain-Name: None Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Identity-Status: Confirmed Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Is-Admin-Project: True Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Project-Domain-Id: default Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Project-Domain-Name: Default Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Project-Id: e806beceabfc4663a407d971dd3d3aa4 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Project-Name: tempest-SnapshotDataIntegrityTests-170973560 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Role: member,reader Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Roles: member,reader Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e806beceabfc4663a407d971dd3d3aa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e806beceabfc4663a407d971dd3d3aa4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e806beceabfc4663a407d971dd3d3aa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Tenant: tempest-SnapshotDataIntegrityTests-170973560 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Tenant-Id: e806beceabfc4663a407d971dd3d3aa4 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-170973560 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-User: tempest-SnapshotDataIntegrityTests-170973560-project-member Apr 18 15:42:11 user devstack@n-api.service[61365]: X-User-Domain-Id: default Apr 18 15:42:11 user devstack@n-api.service[61365]: X-User-Domain-Name: Default Apr 18 15:42:11 user devstack@n-api.service[61365]: X-User-Id: 2637a7dde15b4c48850e6eab7bb0eed9 Apr 18 15:42:11 user devstack@n-api.service[61365]: X-User-Name: tempest-SnapshotDataIntegrityTests-170973560-project-member Apr 18 15:42:11 user devstack@n-api.service[61365]: method: > Apr 18 15:42:11 user devstack@n-api.service[61365]: exception: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. Apr 18 15:42:11 user devstack@n-api.service[61365]: action_args: {'id': '2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29'} Apr 18 15:42:11 user devstack@n-api.service[61365]: {{(pid=61365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. Apr 18 15:42:11 user devstack@n-api.service[61365]: ERROR nova.api.openstack.wsgi Apr 18 15:42:11 user devstack@n-api.service[61365]: DEBUG nova.api.openstack.wsgi [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Returning 404 to user: Instance 2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 could not be found. {{(pid=61365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 15:42:11 user devstack@n-api.service[61365]: INFO nova.api.openstack.requestlog [None req-9438334e-8345-4d59-90f6-f16a6cd55384 tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29" status: 404 len: 111 microversion: 2.1 time: 0.033976 Apr 18 15:42:11 user devstack@n-api.service[61365]: [pid: 61365|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 15:42:11 2023] GET /compute/v2.1/servers/2eb8d4f4-00f3-4aab-b4f9-8ae61ceb5e29 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 15:42:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_api:SELECT=4 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:42:11 user devstack@n-api.service[61366]: DEBUG dbcounter [-] [61366] Writing DB stats nova_cell1:SELECT=8 {{(pid=61366) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 15:42:11 user devstack@n-api.service[61366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 15:42:11 user devstack@n-api.service[61366]: Tue Apr 18 15:42:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1336579351 (ip 10.0.0.210) !!! Apr 18 15:42:11 user devstack@n-api.service[61366]: DEBUG nova.api.openstack.wsgi [None req-fdace0d5-ec49-4938-83cf-cf8905dd587a tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] Calling method '.version_select at 0x7fc26ad28670>' {{(pid=61366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 15:42:11 user devstack@n-api.service[61366]: INFO nova.api.openstack.requestlog [None req-fdace0d5-ec49-4938-83cf-cf8905dd587a tempest-SnapshotDataIntegrityTests-170973560 tempest-SnapshotDataIntegrityTests-170973560-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1336579351" status: 202 len: 0 microversion: 2.1 time: 0.042814 Apr 18 15:42:11 user devstack@n-api.service[61366]: [pid: 61366|app: 0|req: 151/457] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 18 15:42:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1336579351 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)